schema_version: 0.1.0 kind: source id: source.nexuscrm.quote_s3_snapshot name: nexuscrm Quote S3 snapshot export version: 0.1.0 owner: type: team name: data-platform domain: name: crm purpose: Source-faithful per-snapshot Parquet export of nexuscrm.Quote from TiDB Cloud Essential to S3, consumed by the lakehouse load stage. usage: intended: - Bulk load into the raw lakehouse layer - Audit and provenance of exported snapshots prohibited: - Direct analytical querying (load into a contracted product first). - Treating a single snapshot as an intra-day event stream. source: kind: database system: tidbcloud description: TiDB Cloud Essential nexuscrm.Quote identifiers: database: nexuscrm table: Quote cluster_id: '10996361222721502359' assets: - id: quote_s3_snapshot kind: file ref: s3://pingcap-datalake-nexuscrm-export-247906201378-us-west-2/tidb-essential/snapshots/source=nexuscrm/ materialization: external produced_by: kind: python ref: ingestion.extract.tidbcloud.engine.export schema: kind: relational columns: - name: id type: varchar(255) nullable: false - name: ownerid type: varchar(255) nullable: true - name: createdbyid type: varchar(255) nullable: true - name: lastmodifiedbyid type: varchar(255) nullable: true - name: createddate type: datetime nullable: false - name: lastmodifieddate type: datetime nullable: false - name: systemmodstamp type: datetime nullable: false - name: isdeleted type: tinyint(1) nullable: false - name: name type: varchar(255) nullable: false - name: quotenumber type: varchar(255) nullable: true - name: status type: varchar(255) nullable: false - name: opportunityid type: varchar(255) nullable: true - name: accountid type: varchar(255) nullable: true - name: contractid type: varchar(255) nullable: true - name: contactid type: varchar(255) nullable: true - name: expirationdate type: date nullable: true - name: subtotal type: decimal(65,30) nullable: true - name: totalprice type: decimal(65,30) nullable: true - name: discount type: decimal(65,30) nullable: true - name: tax type: decimal(65,30) nullable: true - name: grandtotal type: decimal(65,30) nullable: true - name: email type: varchar(255) nullable: true - name: phone type: varchar(50) nullable: true - name: fax type: varchar(50) nullable: true - name: billingstreet type: text nullable: true - name: billingcity type: varchar(255) nullable: true - name: billingcountry type: varchar(255) nullable: true - name: shippingstreet type: text nullable: true - name: shippingcity type: varchar(255) nullable: true - name: shippingcountry type: varchar(255) nullable: true - name: description type: text nullable: true - name: pricebook2id type: varchar(255) nullable: true - name: currencyisocode type: varchar(255) nullable: true - name: acv_amount_usd__c type: decimal(65,30) nullable: true - name: acv_amount__c type: decimal(65,30) nullable: true - name: acv_amount_do_not_use__c type: decimal(65,30) nullable: true - name: account_country_code__c type: varchar(255) nullable: true - name: account_name_for_email_template__c type: text nullable: true - name: account_owner_for_email_template__c type: text nullable: true - name: additional_discount__c type: decimal(65,30) nullable: true - name: additional_discount_to_reduce_sales_lead__c type: decimal(65,30) nullable: true - name: additional_discount_to_reduce_sales__c type: decimal(65,30) nullable: true - name: approvestatus__c type: varchar(255) nullable: true - name: approvedprice__c type: tinyint(1) nullable: true - name: autonumbertext__c type: varchar(255) nullable: true - name: autonumber__c type: decimal(65,30) nullable: true - name: autoapproval__c type: tinyint(1) nullable: true - name: average_discount__c type: decimal(65,30) nullable: true - name: cp_discount_gap_between_sales_and_rgm__c type: decimal(65,30) nullable: true - name: cp_discount_gap_sales_leader_rgm__c type: decimal(65,30) nullable: true - name: cloud_vendor__c type: varchar(255) nullable: true - name: contains_other_nonstd_terms__c type: tinyint(1) nullable: true - name: create_date__c type: date nullable: true - name: customer_s_cluster_configuration__c type: longtext nullable: true - name: customer_s_consumption_in_last_3_months__c type: longtext nullable: true - name: customer_s_hardware_configuration__c type: longtext nullable: true - name: customers_cluster_configuration__c type: tinyint(1) nullable: true - name: details_of_vcpu_calculation__c type: longtext nullable: true - name: discount_to_trigger_approval__c type: decimal(65,30) nullable: true - name: effective_date__c type: date nullable: true - name: escalate_to_ceo_approval__c type: tinyint(1) nullable: true - name: escalate_to_finance_head_approval__c type: tinyint(1) nullable: true - name: exchange_rate__c type: decimal(65,30) nullable: true - name: finance_internal_comment__c type: text nullable: true - name: how_will_the_customer_place_an_order__c type: varchar(255) nullable: false - name: including_man_days_or_premium_support__c type: tinyint(1) nullable: true - name: initial_quote_record__c type: varchar(255) nullable: true - name: isconvertquote__c type: tinyint(1) nullable: true - name: is_non_standard_program__c type: tinyint(1) nullable: true - name: is_standard_migration_program__c type: tinyint(1) nullable: true - name: is_standard_op_payment_frequency__c type: tinyint(1) nullable: true - name: migration_credit_is_nonstandard__c type: varchar(255) nullable: true - name: minimum_commitment_amount__c type: decimal(65,30) nullable: true - name: need_fp_a_approval_cloud_over_0k__c type: varchar(255) nullable: true - name: need_fp_a_approval_cloud_over_100k__c type: varchar(255) nullable: true - name: need_fp_a_approval_cloud_over_10m__c type: varchar(255) nullable: true - name: need_fp_a_approval_cloud_over_1m__c type: varchar(255) nullable: true - name: need_fp_a_approval_cloud_over_200k__c type: varchar(255) nullable: true - name: need_fp_a_approval_cloud_over_25k__c type: varchar(255) nullable: true - name: need_fp_a_approval_cloud_over_2m__c type: varchar(255) nullable: true - name: need_fp_a_approval_cloud_over_500k__c type: varchar(255) nullable: true - name: need_fp_a_approval_cloud_over_50k__c type: varchar(255) nullable: true - name: need_fp_a_approval_cloud_over_5m__c type: varchar(255) nullable: true - name: need_fp_a_approval_enterprise__c type: varchar(255) nullable: true - name: need_fp_a_approval_pilot__c type: varchar(255) nullable: true - name: need_fp_a_approval_premium__c type: varchar(255) nullable: true - name: need_fp_a_approval_service__c type: varchar(255) nullable: true - name: need_fp_a_approval_standard__c type: varchar(255) nullable: true - name: need_finance_head_approval_cloud_in_1m__c type: varchar(255) nullable: true - name: need_finance_head_approval_cloud_over_1m__c type: varchar(255) nullable: true - name: need_finance_head_approval_enterprise__c type: varchar(255) nullable: true - name: need_finance_head_approval_pilot__c type: varchar(255) nullable: true - name: need_finance_head_approval_premium__c type: varchar(255) nullable: true - name: need_finance_head_approval_service__c type: varchar(255) nullable: true - name: need_finance_head_approval_standard__c type: varchar(255) nullable: true - name: need_rgm_approval_cloud_over_0k__c type: varchar(255) nullable: true - name: need_rgm_approval_cloud_over_100k__c type: varchar(255) nullable: true - name: need_rgm_approval_cloud_over_10m__c type: varchar(255) nullable: true - name: need_rgm_approval_cloud_over_1m__c type: varchar(255) nullable: true - name: need_rgm_approval_cloud_over_200k__c type: varchar(255) nullable: true - name: need_rgm_approval_cloud_over_25k__c type: varchar(255) nullable: true - name: need_rgm_approval_cloud_over_2m__c type: varchar(255) nullable: true - name: need_rgm_approval_cloud_over_500k__c type: varchar(255) nullable: true - name: need_rgm_approval_cloud_over_50k__c type: varchar(255) nullable: true - name: need_rgm_approval_cloud_over_5m__c type: varchar(255) nullable: true - name: need_rgm_approval_enterprise__c type: varchar(255) nullable: true - name: need_rgm_approval_pilot__c type: varchar(255) nullable: true - name: need_rgm_approval_premium__c type: varchar(255) nullable: true - name: need_rgm_approval_service__c type: varchar(255) nullable: true - name: need_rgm_approval_standard__c type: varchar(255) nullable: true - name: need_sales_lead_approval_cloud_over_100k__c type: varchar(255) nullable: true - name: need_sales_lead_approval_cloud_over_10m__c type: varchar(255) nullable: true - name: need_sales_lead_approval_cloud_over_200k__c type: varchar(255) nullable: true - name: need_sales_lead_approval_cloud_over_25k__c type: varchar(255) nullable: true - name: need_sales_lead_approval_cloud_over_500k__c type: varchar(255) nullable: true - name: need_sales_lead_approval_cloud_over_50k__c type: varchar(255) nullable: true - name: need_sales_leader_approval_cloud_over_0k__c type: varchar(255) nullable: true - name: need_sales_leader_approval_cloud_over_1m__c type: varchar(255) nullable: true - name: need_sales_leader_approval_cloud_over_2m__c type: varchar(255) nullable: true - name: need_sales_leader_approval_cloud_over_5m__c type: varchar(255) nullable: true - name: need_sales_leader_approval_enterprise__c type: varchar(255) nullable: true - name: need_sales_leader_approval_pilot__c type: varchar(255) nullable: true - name: need_sales_leader_approval_premium__c type: varchar(255) nullable: true - name: need_sales_leader_approval_service__c type: varchar(255) nullable: true - name: need_sales_leader_approval_standard__c type: varchar(255) nullable: true - name: needapprove__c type: tinyint(1) nullable: true - name: opportunity_name_for_email_template__c type: text nullable: true - name: other_nonstandard_terms_and_conditions__c type: longtext nullable: true - name: partner_margin__c type: decimal(65,30) nullable: true - name: partner_name__c type: varchar(255) nullable: true - name: payment_frequency__c type: text nullable: true - name: payment_term__c type: varchar(255) nullable: false - name: payment_type__c type: varchar(255) nullable: false - name: pingcap_contracting_entity_emea_only__c type: varchar(255) nullable: true - name: prepayment_amount_usd__c type: decimal(65,30) nullable: true - name: product_family__c type: varchar(255) nullable: true - name: product_name__c type: varchar(255) nullable: true - name: quote_no__c type: varchar(255) nullable: true - name: rebate_fee_rate__c type: decimal(65,30) nullable: true - name: referral_fee_rate__c type: decimal(65,30) nullable: true - name: sales_channel_type__c type: varchar(255) nullable: true - name: service_end_date__c type: date nullable: true - name: service_start_date__c type: date nullable: true - name: tcv_amount_usd__c type: decimal(65,30) nullable: true - name: target_product_name__c type: varchar(255) nullable: true - name: tax__c type: decimal(65,30) nullable: true - name: technical_support_level__c type: varchar(255) nullable: true - name: term_months__c type: decimal(65,30) nullable: true - name: tidb_cloud_support_tier__c type: varchar(255) nullable: true - name: total_credit_amount__c type: decimal(65,30) nullable: true - name: version_of_tidb__c type: varchar(255) nullable: true - name: year_s_of_commitment__c type: decimal(65,30) nullable: true - name: vcpu_to_be_ordered__c type: decimal(65,30) nullable: true - name: recordtypeid type: varchar(255) nullable: true - name: discount__c type: decimal(65,30) nullable: true - name: netfees__c type: decimal(65,30) nullable: true - name: overall_end_date__c type: date nullable: true - name: overall_start_date__c type: date nullable: true - name: tcv_amount_c__c type: decimal(65,30) nullable: true - name: total_list_price__c type: decimal(65,30) nullable: true freshness: max_age: PT48H degrade_after: PT30H tests: - id: quote_source_smoke type: sql severity: informational description: Placeholder informational smoke check for the source contract of quote. Replace with concrete row-count, freshness, or key-uniqueness assertions. sql: select 1 governance: classifications: - customer_data - financial - pii - restricted access: default: restricted retention: period: P7D audit: required: true events: - export - agent_action agent_permissions: default: deny compatibility: change_policy: semver extensions: primary_key: - Id watermark_columns: - SystemModstamp - LastModifiedDate row_estimate: 899 known_blind_spots: - Intra-snapshot changes are collapsed. - Insert-then-delete between snapshots is invisible. - Schema drift requires review before promotion.