Old data lake audit. Part of what the twin can answer. Every figure below is the value the route serves, with its source; the raw response is at /api/twin/brain/omttaudit.
Descriptive, sourced: no model
Basis: sourced records (URL, sha256 or locator per row), no model.
Retain 3 referenced datasets, confirm 15 superseded tables, and safely cold-archive the 9 legacy crawl and raw report trees.
| Sector | Corporate | Personal | Total | Share of all |
|---|---|---|---|---|
| Other |
| Dataset | Collection | Size | Files | Parquet rows | Verdict |
|---|---|---|---|---|---|
| NBR Budget & Direct Tax Expenditure Extracts | Collection: Extracted | Size: 10.5 MB | Files: 12 |
| Source | Publisher | Unit |
|---|---|---|
| OMTT Data Lake Dataset Audit Inventory | Publisher: BDPolicyLab historical data lake audit (gap row A17) | Unit: one row per audited dataset/collection across 16 domains |
| NBR Direct Tax Expenditure Estimation FY2022-23 | Publisher: National Board of Revenue (NBR), Ministry of Finance, Government of Bangladesh | Unit: |
| Personal: Tk 24,330 crore |
| Total: Tk 53,066 crore |
| Share of all: 49.53% |
| Microcredit/Social welfare | Corporate: Tk 12,589 crore | Personal: Tk 0 crore | Total: Tk 12,589 crore | Share of all: 11.75% |
| Power and energy | Corporate: Tk 7,987 crore | Personal: Tk 0 crore | Total: Tk 7,987 crore | Share of all: 7.46% |
| Share capital gain | Corporate: Tk 6,254 crore | Personal: Tk 817 crore | Total: Tk 7,071 crore | Share of all: 6.6% |
| Garments/Textiles/Accessories | Corporate: Tk 5,829 crore | Personal: Tk 0 crore | Total: Tk 5,829 crore | Share of all: 5.44% |
| Salary | Corporate: Tk 0 crore | Personal: Tk 5,325 crore | Total: Tk 5,325 crore | Share of all: 4.97% |
| Verdict: Referenced and needed |
| Old Portal Sites Crawl (May 2026) | Collection: Extracted | Size: 7.4 GB | Files: 55,917 | Parquet rows: 1,322,162 | Verdict: Archive |
| Ministry of Finance Historical Document Extracts | Collection: Extracted | Size: 107.1 MB | Files: 1,307 | Parquet rows: 0 | Verdict: Archive |
| Humanitarian Data Exchange (HDX) Document Extracts | Collection: Extracted | Size: 189.7 MB | Files: 2,057 | Parquet rows: 11,620,235 | Verdict: Archive |
| Bangladesh Policy Think-Tank Extracts (CPD, BIGD, SANEM, BIDS) | Collection: Extracted | Size: 101.5 MB | Files: 578 | Parquet rows: 0 | Verdict: Archive |
| Annual Performance Agreement (APA) Extracts | Collection: Extracted | Size: 4.2 MB | Files: 27 | Parquet rows: 0 | Verdict: Superseded |
| Demands for Grants Budget Extracts | Collection: Extracted | Size: 6.5 MB | Files: 29 | Parquet rows: 0 | Verdict: Superseded |
| Harvard Dataverse Bangladesh Research Studies | Collection: Microdata | Size: 11.9 GB | Files: 767 | Parquet rows: 5,304,376 | Verdict: Referenced and needed |
| Legacy GovTwin Prototype Parquets (May 2026) | Collection: Lake | Size: 577.7 KB | Files: 20 | Parquet rows: 3,131 | Verdict: Superseded |
| Legacy ADP Projects Parquet | Collection: Lake | Size: 548.4 KB | Files: 1 | Parquet rows: 1,356 | Verdict: Superseded |
| Legacy Labour Force Survey Microdata Panel | Collection: Lake | Size: 13.7 MB | Files: 1 | Parquet rows: 595,375 | Verdict: Superseded |
| Legacy Demographic and Health Survey Panel | Collection: Lake | Size: 6.9 KB | Files: 1 | Parquet rows: 171 | Verdict: Superseded |
| Legacy Data Catalog (121k series) | Collection: Lake | Size: 3.7 MB | Files: 1 | Parquet rows: 121,261 | Verdict: Superseded |
| TradeWeave Curated Bilateral Parquets | Collection: Curated | Size: 19.6 MB | Files: 44 | Parquet rows: 4,940,902 | Verdict: Superseded |
| BDFacts Curated Tables | Collection: Curated | Size: 416.6 KB | Files: 61 | Parquet rows: 1,238 | Verdict: Superseded |
| Google Earth Engine District Zonal Reductions | Collection: Geo | Size: 164.3 KB | Files: 12 | Parquet rows: 14,430 | Verdict: Superseded |
| HDX Raw Datasets Archive (25 GB) | Collection: HDX | Size: 25.0 GB | Files: 1,587 | Parquet rows: 646,987 | Verdict: Superseded |
| IPUMS International Bangladesh Census 2011 Sample | Collection: IPUMS | Size: 712.3 MB | Files: 12 | Parquet rows: 30,228,739 | Verdict: Superseded |
| OpenStreetMap Bangladesh Transport & POI Parquets | Collection: OSM | Size: 388.2 MB | Files: 4 | Parquet rows: 11,617,726 | Verdict: Superseded |
| Our World In Data Series | Collection: OWID | Size: 19.1 MB | Files: 83 | Parquet rows: 5,279 | Verdict: Superseded |
| Official Government PDF Reports (14 GB, 4,596 files) | Collection: Reports | Size: 14.0 GB | Files: 4,596 | Parquet rows: 0 | Verdict: Archive |
| Raw HTML Crawls & Constituency Extracts (17.4k files) | Collection: Raw | Size: 1.6 GB | Files: 17,461 | Parquet rows: 4,557,490 | Verdict: Archive |
| Intermediate Research Checkpoints & Accounting Matrices | Collection: Research | Size: 277.2 MB | Files: 123 | Parquet rows: 129,163 | Verdict: Archive |
| Legacy Policy Domain Taxonomy Drafts (May 2026) | Collection: Taxonomy history | Size: 193.6 KB | Files: 170 | Parquet rows: 0 | Verdict: Archive |
| CGE Macroeconomic Prior Calibrations | Collection: Calibration | Size: 493 B | Files: 2 | Parquet rows: 0 | Verdict: Archive |
| World Bank Business Ready (B-READY) 2024/25 Dataset | Collection: B-READY | Size: 11.1 MB | Files: 4 | Parquet rows: 0 | Verdict: Superseded |
| Sprint Twin Backup Destination cited in Provenance Receipts | Collection: Backup | Size: N/A | Files: 0 | Parquet rows: 0 | Verdict: Referenced and needed |
NBR Budget and Direct Tax Expenditure Extracts · Old Portal Sites Crawl (May 2026) · Ministry of Finance Historical Document Extracts · Humanitarian Data Exchange (HDX) Document Extracts · Bangladesh Policy Think-Tank Extracts (CPD, BIGD, SANEM, BIDS) · Annual Performance Agreement (APA) Extracts · Demands for Grants Budget Extracts · Harvard Dataverse Bangladesh Research Studies · Legacy GovTwin Prototype Parquets (May 2026) · Legacy ADP Projects Parquet · Legacy Labour Force Survey Microdata Panel · Legacy Demographic and Health Survey Panel · Legacy Data Catalog (121k series) · TradeWeave Curated Bilateral Parquets · BDFacts Curated Tables · Google Earth Engine District Zonal Reductions · HDX Raw Datasets Archive (25 GB) · IPUMS International Bangladesh Census 2011 Sample · OpenStreetMap Bangladesh Transport and POI Parquets · Our World In Data Series · Official Government PDF Reports (14 GB, 4,596 files) · Raw HTML Crawls and Constituency Extracts (17.4k files) · Intermediate Research Checkpoints and Accounting Matrices · Legacy Policy Domain Taxonomy Drafts (May 2026) · CGE Macroeconomic Prior Calibrations · World Bank Business Ready (B-READY) 2024/25 Dataset · Sprint Twin Backup Destination cited in Provenance Receipts