schema_version: 0.1.0 kind: source id: source.nexuscrm.order_s3_snapshot name: nexuscrm Order S3 snapshot export version: 0.1.0 owner: type: team name: data-platform domain: name: crm purpose: Source-faithful per-snapshot Parquet export of nexuscrm.Order from TiDB Cloud Essential to S3, consumed by the lakehouse load stage. usage: intended: - Bulk load into the raw lakehouse layer - Audit and provenance of exported snapshots prohibited: - Direct analytical querying (load into a contracted product first). - Treating a single snapshot as an intra-day event stream. source: kind: database system: tidbcloud description: TiDB Cloud Essential nexuscrm.Order identifiers: database: nexuscrm table: Order cluster_id: '10996361222721502359' assets: - id: order_s3_snapshot kind: file ref: s3://pingcap-datalake-nexuscrm-export-247906201378-us-west-2/tidb-essential/snapshots/source=nexuscrm/ materialization: external produced_by: kind: python ref: ingestion.extract.tidbcloud.engine.export schema: kind: relational columns: - name: id type: varchar(255) nullable: false - name: ownerid type: varchar(255) nullable: true - name: createdbyid type: varchar(255) nullable: true - name: lastmodifiedbyid type: varchar(255) nullable: true - name: createddate type: datetime nullable: false - name: lastmodifieddate type: datetime nullable: false - name: systemmodstamp type: datetime nullable: false - name: isdeleted type: tinyint(1) nullable: false - name: ordernumber type: varchar(255) nullable: true - name: accountid type: varchar(255) nullable: false - name: contractid type: varchar(255) nullable: true - name: quoteid type: varchar(255) nullable: true - name: recordtypeid type: varchar(255) nullable: true - name: status type: varchar(255) nullable: false - name: effectivedate type: date nullable: false - name: enddate type: date nullable: true - name: totalamount type: decimal(65,30) nullable: true - name: description type: text nullable: true - name: type type: varchar(255) nullable: true - name: statuscode type: varchar(255) nullable: true - name: activateddate type: datetime nullable: true - name: activatedbyid type: varchar(255) nullable: true - name: opportunityid type: varchar(255) nullable: true - name: pricebook2id type: varchar(255) nullable: true - name: currencyisocode type: varchar(255) nullable: false - name: acv_amount_usd__c type: decimal(65,30) nullable: true - name: acv_amount__c type: decimal(65,30) nullable: true - name: acv_amount_do_not_use__c type: decimal(65,30) nullable: true - name: acv_usd_with_cd_rate__c type: decimal(65,30) nullable: true - name: account_country_code__c type: varchar(255) nullable: true - name: account_id__c type: varchar(255) nullable: true - name: account_name_for_email_template__c type: text nullable: true - name: accumulate_revenue_to_org__c type: varchar(255) nullable: true - name: applicable_law__c type: varchar(255) nullable: true - name: approval_status__c type: varchar(255) nullable: true - name: archived_order_form__c type: varchar(255) nullable: true - name: archived__c type: tinyint(1) nullable: true - name: autonumbertext__c type: varchar(255) nullable: true - name: autonumber__c type: decimal(65,30) nullable: true - name: average_discount__c type: decimal(65,30) nullable: true - name: billtocontactid type: varchar(255) nullable: true - name: cd_rate__c type: decimal(65,30) nullable: true - name: cash_collected_usd__c type: decimal(65,30) nullable: true - name: cash_collected__c type: decimal(65,30) nullable: true - name: cash_uncollected_usd__c type: decimal(65,30) nullable: true - name: cash_uncollected__c type: decimal(65,30) nullable: true - name: closed_days_in_61__c type: tinyint(1) nullable: true - name: closed_days_out_61__c type: tinyint(1) nullable: true - name: closed_days__c type: decimal(65,30) nullable: true - name: cloud_order_type__c type: varchar(255) nullable: true - name: cloud_registration_source__c type: text nullable: true - name: companyauthorizedbyid type: varchar(255) nullable: true - name: contain_earlier_termination_clause__c type: tinyint(1) nullable: true - name: contract_number__c type: varchar(255) nullable: true - name: currency_for_finance__c type: varchar(255) nullable: true - name: customerauthorizedbyid type: varchar(255) nullable: true - name: deal_registration__c type: varchar(255) nullable: true - name: deferred_revenue_usd__c type: decimal(65,30) nullable: true - name: deferred_revenue__c type: decimal(65,30) nullable: true - name: email__c type: varchar(255) nullable: true - name: exchange_rate__c type: decimal(65,30) nullable: true - name: exchange_rate_from_revrec__c type: decimal(65,30) nullable: true - name: exchange_rate_to_use__c type: decimal(65,30) nullable: true - name: fiscal_period__c type: varchar(255) nullable: true - name: gross_margin__c type: decimal(65,30) nullable: true - name: is_nonstandard_order__c type: tinyint(1) nullable: true - name: is_stripe__c type: tinyint(1) nullable: true - name: monthly_cost__c type: decimal(65,30) nullable: true - name: net_fees_usd__c type: decimal(65,30) nullable: true - name: nonstandarduploadurl__c type: varchar(255) nullable: true - name: non_standard_type__c type: varchar(255) nullable: true - name: op_paid_via_marketplace__c type: tinyint(1) nullable: true - name: order_end_date__c type: date nullable: true - name: order_expiration_alert__c type: tinyint(1) nullable: true - name: order_id_18_digitals__c type: varchar(255) nullable: true - name: order_number__c type: varchar(255) nullable: true - name: order_record_type__c type: varchar(255) nullable: true - name: order_is_terminated__c type: tinyint(1) nullable: true - name: order_to_be_deleted__c type: tinyint(1) nullable: true - name: org__c type: varchar(255) nullable: true - name: originalorderid type: varchar(255) nullable: true - name: owned_dm__c type: varchar(255) nullable: true - name: plg_bd_pool__c type: tinyint(1) nullable: true - name: partner_margin__c type: decimal(65,30) nullable: true - name: partner_name__c type: varchar(255) nullable: true - name: payment_term__c type: varchar(255) nullable: true - name: payment_type__c type: varchar(255) nullable: true - name: pingcap_contracting_entity_emea_only__c type: varchar(255) nullable: true - name: pingcap_contracting_entity__c type: varchar(255) nullable: true - name: pingcap_revrec_entity__c type: varchar(255) nullable: true - name: prepayment_or_not__c type: varchar(255) nullable: true - name: product_family__c type: varchar(255) nullable: true - name: real_booking_date__c type: date nullable: true - name: reason__c type: varchar(255) nullable: true - name: rebate_fee_rate__c type: decimal(65,30) nullable: true - name: recognized_revenue_usd__c type: decimal(65,30) nullable: true - name: recognized_revenue__c type: decimal(65,30) nullable: true - name: referral_fee_rate__c type: decimal(65,30) nullable: true - name: region__c type: varchar(255) nullable: true - name: related_original_order__c type: varchar(255) nullable: true - name: spiff_justification__c type: text nullable: true - name: spiff_program__c type: json nullable: true - name: sales_channel_type__c type: varchar(255) nullable: true - name: shiptocontactid type: varchar(255) nullable: true - name: standarduploadurl__c type: varchar(255) nullable: true - name: stripe_bill_id__c type: varchar(255) nullable: true - name: tcv_amount_usd__c type: decimal(65,30) nullable: true - name: tcv_amount__c type: decimal(65,30) nullable: true - name: tax__c type: decimal(65,30) nullable: true - name: term__c type: decimal(65,30) nullable: true - name: termination_date__c type: date nullable: true - name: total_fees_new__c type: decimal(65,30) nullable: true - name: total_fees_usd__c type: decimal(65,30) nullable: true - name: total_fees__c type: decimal(65,30) nullable: true - name: validdays__c type: decimal(65,30) nullable: true - name: version_of_tidb__c type: varchar(255) nullable: true - name: write_off_date__c type: date nullable: true - name: x30_alert_arranged_date__c type: date nullable: true - name: x60_alert_arranged_date__c type: date nullable: true - name: x90_alert_arranged_date__c type: date nullable: true - name: vcpu__c type: decimal(65,30) nullable: true - name: accumulated_credit_amount__c type: decimal(65,30) nullable: true - name: accumulated_payable_amount__c type: decimal(65,30) nullable: true - name: accumulated_revenue_before_adjust__c type: decimal(65,30) nullable: true - name: cash_collected_amount__c type: decimal(65,30) nullable: true - name: cash_collected_amount_usd__c type: decimal(65,30) nullable: true - name: cash_collected_exc_tax_amount__c type: decimal(65,30) nullable: true - name: cash_collected_usd_exc_tax__c type: decimal(65,30) nullable: true - name: count_product_lines__c type: decimal(65,30) nullable: true - name: latest_payable_date__c type: date nullable: true - name: name type: varchar(255) nullable: true - name: net_fees__c type: decimal(65,30) nullable: true - name: overall_end_date__c type: date nullable: true - name: overall_start_date__c type: date nullable: true - name: payable_amount_usd_exc_tax__c type: decimal(65,30) nullable: true - name: recognized_revenue_amount__c type: decimal(65,30) nullable: true - name: recognized_revenue_amount_usd__c type: decimal(65,30) nullable: true - name: total_list_price__c type: decimal(65,30) nullable: true freshness: max_age: PT48H degrade_after: PT30H tests: - id: order_source_smoke type: sql severity: informational description: Placeholder informational smoke check for the source contract of order. Replace with concrete row-count, freshness, or key-uniqueness assertions. sql: select 1 governance: classifications: - customer_data - financial - operational_sensitive - pii - restricted access: default: restricted retention: period: P7D audit: required: true events: - export - agent_action agent_permissions: default: deny compatibility: change_policy: semver extensions: primary_key: - Id watermark_columns: - SystemModstamp - LastModifiedDate row_estimate: 5014 known_blind_spots: - Intra-snapshot changes are collapsed. - Insert-then-delete between snapshots is invisible. - Schema drift requires review before promotion.