schema_version: 0.1.0 kind: source id: source.nexuscrm.poc__c_s3_snapshot name: nexuscrm PoC__c S3 snapshot export version: 0.1.0 owner: type: team name: data-platform domain: name: crm purpose: Source-faithful per-snapshot Parquet export of nexuscrm.PoC__c from TiDB Cloud Essential to S3, consumed by the lakehouse load stage. usage: intended: - Bulk load into the raw lakehouse layer - Audit and provenance of exported snapshots prohibited: - Direct analytical querying (load into a contracted product first). - Treating a single snapshot as an intra-day event stream. source: kind: database system: tidbcloud description: TiDB Cloud Essential nexuscrm.PoC__c identifiers: database: nexuscrm table: PoC__c cluster_id: '10996361222721502359' assets: - id: poc__c_s3_snapshot kind: file ref: s3://pingcap-datalake-nexuscrm-export-247906201378-us-west-2/tidb-essential/snapshots/source=nexuscrm/ materialization: external produced_by: kind: python ref: ingestion.extract.tidbcloud.engine.export schema: kind: relational columns: - name: id type: varchar(255) nullable: false - name: ownerid type: varchar(255) nullable: true - name: createdbyid type: varchar(255) nullable: true - name: lastmodifiedbyid type: varchar(255) nullable: true - name: createddate type: datetime nullable: false - name: lastmodifieddate type: datetime nullable: false - name: systemmodstamp type: datetime nullable: false - name: isdeleted type: tinyint(1) nullable: false - name: account_name__c type: varchar(255) nullable: true - name: account__c type: varchar(255) nullable: true - name: alicloud_channel__c type: tinyint(1) nullable: true - name: application_link__c type: varchar(255) nullable: true - name: approvalstatus__c type: varchar(255) nullable: true - name: approval_poc_number__c type: decimal(65,30) nullable: true - name: approved_date__c type: date nullable: true - name: business_leader_approval_or_not__c type: tinyint(1) nullable: true - name: cloud_credits_requested__c type: decimal(65,30) nullable: true - name: company_name__c type: varchar(255) nullable: true - name: contact__c type: varchar(255) nullable: true - name: credits_needed_f__c type: decimal(65,30) nullable: true - name: enough_man_power_available_for_the_poc__c type: tinyint(1) nullable: true - name: external_id__c type: varchar(255) nullable: true - name: first_name__c type: varchar(255) nullable: true - name: internal_user__c type: tinyint(1) nullable: true - name: invalid__c type: tinyint(1) nullable: true - name: justification_to_points_needed__c type: text nullable: true - name: last_modified_text__c type: text nullable: true - name: last_name__c type: varchar(255) nullable: true - name: lead_owner__c type: varchar(255) nullable: true - name: lead__c type: varchar(255) nullable: true - name: need_convert__c type: tinyint(1) nullable: true - name: opportunity__c type: varchar(255) nullable: true - name: org__c type: varchar(255) nullable: true - name: phone_number__c type: varchar(255) nullable: true - name: poc_completed_date__c type: datetime nullable: true - name: poc_customer_payment__c type: varchar(255) nullable: true - name: poc_duration_days__c type: decimal(65,30) nullable: true - name: poc_failed_reason__c type: varchar(255) nullable: true - name: poc_grading__c type: varchar(255) nullable: true - name: poc_start_date__c type: datetime nullable: true - name: poc_status__c type: varchar(255) nullable: true - name: poc_successful_criteria__c type: longtext nullable: true - name: points_expiry_date__c type: date nullable: true - name: points_needed__c type: decimal(65,30) nullable: true - name: pre_sales__c type: varchar(255) nullable: true - name: presales_auto_approve__c type: tinyint(1) nullable: true - name: proposed_poc_end_date__c type: date nullable: true - name: proposed_poc_start_date__c type: date nullable: true - name: rwp_engagement__c type: tinyint(1) nullable: true - name: recordtypedevelopername__c type: varchar(255) nullable: true - name: regiongpe__c type: varchar(255) nullable: true - name: region_leader__c type: varchar(255) nullable: true - name: region__c type: varchar(255) nullable: true - name: regional_finance__c type: varchar(255) nullable: true - name: regional_sdr__c type: varchar(255) nullable: true - name: related_poc_number__c type: varchar(255) nullable: true - name: sales_manager__c type: varchar(255) nullable: true - name: sales_owner__c type: varchar(255) nullable: true - name: score__c type: decimal(65,30) nullable: true - name: survey_link__c type: varchar(255) nullable: true - name: survey_template__c type: varchar(255) nullable: true - name: tech_support__c type: varchar(255) nullable: true - name: tidb_cloud_account_id_to_run_this_poc__c type: varchar(255) nullable: true - name: tidb_s_premium_scenario__c type: tinyint(1) nullable: true - name: work_email__c type: varchar(255) nullable: true - name: message__c type: text nullable: true - name: subtopic__c type: varchar(255) nullable: true - name: recordtypeid type: varchar(255) nullable: true - name: name type: varchar(255) nullable: true freshness: max_age: PT48H degrade_after: PT30H tests: - id: poc__c_source_smoke type: sql severity: informational description: Placeholder informational smoke check for the source contract of poc__c. Replace with concrete row-count, freshness, or key-uniqueness assertions. sql: select 1 governance: classifications: - customer_data - financial - pii - restricted access: default: restricted retention: period: P7D audit: required: true events: - export - agent_action agent_permissions: default: deny compatibility: change_policy: semver extensions: primary_key: - Id watermark_columns: - SystemModstamp - LastModifiedDate row_estimate: 928 known_blind_spots: - Intra-snapshot changes are collapsed. - Insert-then-delete between snapshots is invisible. - Schema drift requires review before promotion.