schema_version: 0.1.0 kind: source id: source.nexuscrm.account_s3_snapshot name: nexuscrm Account S3 snapshot export version: 0.1.0 owner: type: team name: data-platform domain: name: crm purpose: Source-faithful per-snapshot Parquet export of nexuscrm.Account from TiDB Cloud Essential to S3, consumed by the lakehouse load stage. usage: intended: - Bulk load into the raw lakehouse layer - Audit and provenance of exported snapshots prohibited: - Direct analytical querying (load into a contracted product first). - Treating a single snapshot as an intra-day event stream. source: kind: database system: tidbcloud description: TiDB Cloud Essential nexuscrm.Account identifiers: database: nexuscrm table: Account cluster_id: '10996361222721502359' assets: - id: account_s3_snapshot kind: file ref: s3://pingcap-datalake-nexuscrm-export-247906201378-us-west-2/tidb-essential/snapshots/source=nexuscrm/ materialization: external produced_by: kind: python ref: ingestion.extract.tidbcloud.engine.export schema: kind: relational columns: - name: id type: varchar(255) nullable: false - name: ownerid type: varchar(255) nullable: true - name: createdbyid type: varchar(255) nullable: true - name: lastmodifiedbyid type: varchar(255) nullable: true - name: createddate type: datetime nullable: false - name: lastmodifieddate type: datetime nullable: false - name: systemmodstamp type: datetime nullable: false - name: isdeleted type: tinyint(1) nullable: false - name: name type: varchar(255) nullable: false - name: type type: varchar(255) nullable: true - name: parentid type: varchar(255) nullable: true - name: phone type: varchar(50) nullable: true - name: fax type: varchar(50) nullable: true - name: website type: varchar(255) nullable: true - name: industry type: varchar(255) nullable: true - name: annualrevenue type: decimal(65,30) nullable: true - name: numberofemployees type: decimal(65,30) nullable: true - name: description type: text nullable: true - name: rating type: varchar(255) nullable: true - name: accountsource type: varchar(255) nullable: true - name: billingstreet type: text nullable: true - name: billingcity type: varchar(255) nullable: true - name: billingstate type: varchar(255) nullable: true - name: billingpostalcode type: varchar(255) nullable: true - name: billingcountry type: varchar(255) nullable: true - name: billingcountrycode type: varchar(255) nullable: true - name: shippingstreet type: text nullable: true - name: shippingcity type: varchar(255) nullable: true - name: shippingstate type: varchar(255) nullable: true - name: shippingpostalcode type: varchar(255) nullable: true - name: shippingcountry type: varchar(255) nullable: true - name: shippingcountrycode type: varchar(255) nullable: true - name: accountnumber type: varchar(255) nullable: true - name: sic type: varchar(255) nullable: true - name: tickersymbol type: varchar(255) nullable: true - name: site type: varchar(255) nullable: true - name: dunsnumber type: varchar(255) nullable: true - name: tradestyle type: varchar(255) nullable: true - name: naicsdesc type: varchar(255) nullable: true - name: yearstarted type: varchar(255) nullable: true - name: sicdesc type: varchar(255) nullable: true - name: recordtypeid type: varchar(255) nullable: true - name: acvamount__c type: decimal(65,30) nullable: true - name: accept_service__c type: tinyint(1) nullable: true - name: accountstatus__c type: varchar(255) nullable: true - name: account_id__c type: varchar(255) nullable: true - name: account_link__c type: varchar(255) nullable: true - name: account_name_original__c type: varchar(255) nullable: true - name: account_plan__c type: longtext nullable: true - name: account_progress__c type: text nullable: true - name: account_status__c type: varchar(255) nullable: true - name: account_summary_ori__c type: text nullable: true - name: account_summary__c type: longtext nullable: true - name: account_tags_ori__c type: varchar(255) nullable: true - name: account_tags__c type: longtext nullable: true - name: account_type_for_apac_only__c type: varchar(255) nullable: true - name: accumulate_revenue_to_org__c type: text nullable: true - name: alicloud_channel__c type: tinyint(1) nullable: true - name: annualrevenue__c type: varchar(255) nullable: true - name: approval_poc_number__c type: decimal(65,30) nullable: true - name: bn_website_domain__c type: varchar(255) nullable: true - name: bn_website_domain_and_path__c type: varchar(255) nullable: true - name: cldr__active_accounts__c type: decimal(65,30) nullable: true - name: cloud_production_customer_justification__c type: text nullable: true - name: cloud_production_customer__c type: varchar(255) nullable: true - name: cloud_registration_source__c type: varchar(255) nullable: true - name: cloud_vendors__c type: json nullable: true - name: company_zip_code__c type: varchar(255) nullable: true - name: competency_yes_no__c type: tinyint(1) nullable: true - name: connection_type__c type: varchar(255) nullable: true - name: contract_number__c type: varchar(255) nullable: true - name: contract_valid_date__c type: date nullable: true - name: contract_valid_days__c type: decimal(65,30) nullable: true - name: contract_valid__c type: tinyint(1) nullable: true - name: country11__c type: varchar(255) nullable: true - name: country__c type: varchar(255) nullable: true - name: current_effective_pna__c type: varchar(255) nullable: true - name: current_order_type__c type: varchar(255) nullable: true - name: current_pna_end_date__c type: date nullable: true - name: customer_fit__c type: varchar(255) nullable: true - name: dozisf__zoominfo_enrich_status__c type: varchar(255) nullable: true - name: dozisf__zoominfo_first_updated__c type: datetime nullable: true - name: dozisf__zoominfo_id__c type: varchar(255) nullable: true - name: dozisf__zoominfo_inboxai_id__c type: varchar(255) nullable: true - name: dozisf__zoominfo_last_updated__c type: datetime nullable: true - name: developer_activity_score__c type: varchar(255) nullable: true - name: domain_rank__c type: decimal(65,30) nullable: true - name: employees__c type: varchar(255) nullable: true - name: fy22_ib__c type: tinyint(1) nullable: true - name: fy25_acv_expectation__c type: varchar(255) nullable: true - name: fy25_ppl_gap_for_apac_only__c type: decimal(65,30) nullable: true - name: first_order_start_date__c type: date nullable: true - name: former_account_name_if_any__c type: text nullable: true - name: founded_year__c type: date nullable: true - name: fraud_user__c type: varchar(255) nullable: true - name: funding_rounds__c type: text nullable: true - name: googleformid__c type: varchar(255) nullable: true - name: hq_city__c type: varchar(255) nullable: true - name: hq_country__c type: varchar(255) nullable: true - name: hq_state_province__c type: varchar(255) nullable: true - name: heavy_user_type__c type: varchar(255) nullable: true - name: heavy_user__c type: tinyint(1) nullable: true - name: icp__c type: varchar(255) nullable: true - name: ifautosetowner__c type: tinyint(1) nullable: true - name: installbase_since__c type: varchar(255) nullable: true - name: internal_user_bg__c type: varchar(255) nullable: true - name: internal_user__c type: tinyint(1) nullable: true - name: investors__c type: text nullable: true - name: key_milestone__c type: json nullable: true - name: last_activity_date__c type: varchar(255) nullable: true - name: last_funding_round_amount__c type: decimal(65,30) nullable: true - name: last_funding_round_date__c type: date nullable: true - name: latest_month_arr__c type: decimal(65,30) nullable: true - name: lighthouse_logo_justification__c type: longtext nullable: true - name: lighthouse__c type: varchar(255) nullable: true - name: linkedin_company_profile_url__c type: varchar(255) nullable: true - name: location__c type: longtext nullable: true - name: must_win_for_apac_only__c type: tinyint(1) nullable: true - name: named_account__c type: varchar(255) nullable: true - name: new_pna_end_date__c type: date nullable: true - name: no_of_certifications__c type: varchar(255) nullable: true - name: no_sync_from_ops__c type: tinyint(1) nullable: true - name: no_sync_from_stripe__c type: tinyint(1) nullable: true - name: number_of_employees__c type: varchar(255) nullable: true - name: operatinghoursid type: varchar(255) nullable: true - name: owner_isactive__c type: tinyint(1) nullable: true - name: owner_profile__c type: varchar(255) nullable: true - name: plg_bd_pool__c type: tinyint(1) nullable: true - name: pna_status__c type: varchar(255) nullable: true - name: parent_company_name__c type: varchar(255) nullable: true - name: partner_program__c type: json nullable: true - name: partner_sales_email__c type: varchar(255) nullable: true - name: partner_status__c type: varchar(255) nullable: true - name: past_1_year_employee_growth_rate__c type: varchar(255) nullable: true - name: past_2_year_employee_growth_rate__c type: varchar(255) nullable: true - name: pingcap_contracting_entity__c type: varchar(255) nullable: true - name: portal_id__c type: varchar(255) nullable: true - name: region__c type: varchar(255) nullable: true - name: registration_status__c type: varchar(255) nullable: true - name: reseller__c type: tinyint(1) nullable: true - name: revenue__c type: decimal(65,30) nullable: true - name: s1_response_time__c type: text nullable: true - name: s1_response_in__c type: varchar(255) nullable: true - name: s2_response_time__c type: text nullable: true - name: s2_response_in__c type: varchar(255) nullable: true - name: s3_response_time__c type: text nullable: true - name: s3_response_in__c type: varchar(255) nullable: true - name: s4_response_time__c type: text nullable: true - name: s4_response_in__c type: varchar(255) nullable: true - name: saas_team_na_only__c type: tinyint(1) nullable: true - name: sales_team_na_only__c type: varchar(255) nullable: true - name: sales_territory_na_only__c type: varchar(255) nullable: true - name: segment_name__c type: varchar(255) nullable: true - name: segmentation_for_na_emea_reference__c type: varchar(255) nullable: true - name: segmentation__c type: varchar(255) nullable: true - name: service_partner__c type: tinyint(1) nullable: true - name: solution_partner__c type: tinyint(1) nullable: true - name: support_period__c type: varchar(255) nullable: true - name: sync_restart_date_stripe__c type: date nullable: true - name: tam__c type: varchar(255) nullable: true - name: tcp_for_na_only__c type: varchar(255) nullable: true - name: target_account_for_na_only__c type: varchar(255) nullable: true - name: technical_support_level__c type: varchar(255) nullable: true - name: tidb_cloud_prospect__c type: varchar(255) nullable: true - name: ticker__c type: varchar(255) nullable: true - name: time_zone__c type: varchar(255) nullable: true - name: total_funding__c type: decimal(65,30) nullable: true - name: vertical__c type: varchar(255) nullable: true - name: website_referrer_url__c type: text nullable: true - name: weeklyupdate__c type: longtext nullable: true - name: why_not_tidb_cloud__c type: varchar(255) nullable: true - name: x_team_na_only__c type: tinyint(1) nullable: true - name: zoominfo_industry__c type: longtext nullable: true - name: zoominfo_primary_industry__c type: longtext nullable: true - name: zoominfo_account_id__c type: varchar(255) nullable: true - name: account_allias__c type: varchar(255) nullable: true - name: affectlayer__affectlayer_notes__c type: varchar(255) nullable: true - name: affectlayer__iscreatedbychoruszi__c type: tinyint(1) nullable: true - name: agreement_time__c type: datetime nullable: true - name: billing_email__c type: varchar(255) nullable: true - name: bind_credit_card_a__c type: datetime nullable: true - name: counter_party_code__c type: varchar(255) nullable: true - name: created_at__c type: datetime nullable: true - name: ip_address__c type: varchar(255) nullable: true - name: keymessages__c type: text nullable: true - name: linkedin_si__company_profile__c type: varchar(255) nullable: true - name: remaining_points__c type: decimal(65,30) nullable: true - name: utm_campaign__c type: varchar(255) nullable: true - name: utm_content__c type: varchar(255) nullable: true - name: utm_medium__c type: varchar(255) nullable: true - name: utm_source__c type: varchar(255) nullable: true - name: utm_term__c type: varchar(255) nullable: true - name: currencyisocode type: varchar(255) nullable: true - name: lastactivitydate type: date nullable: true - name: open_pipeline_acv__c type: decimal(65,30) nullable: true - name: ownership type: varchar(255) nullable: true - name: approvalstatus__c type: varchar(255) nullable: true freshness: max_age: PT48H degrade_after: PT30H tests: - id: account_source_smoke type: sql severity: informational description: Placeholder informational smoke check for the source contract of account. Replace with concrete row-count, freshness, or key-uniqueness assertions. sql: select 1 governance: classifications: - customer_data - financial - operational_sensitive - pii - restricted access: default: restricted retention: period: P7D audit: required: true events: - export - agent_action agent_permissions: default: deny compatibility: change_policy: semver extensions: primary_key: - Id watermark_columns: - SystemModstamp - LastModifiedDate row_estimate: 3304 known_blind_spots: - Intra-snapshot changes are collapsed. - Insert-then-delete between snapshots is invisible. - Schema drift requires review before promotion.