MilkMp

7 ms·

1. 1.▲
   by MilkMp 7mo ago

   Hi there, yes I used AI to help build this website. I personally don’t have the time nor the talent to build something like this from scratch! I do have knowledge in how historical and crime data are suppose to parsed,viewed, analyzed, and
2. 2.▲
   by MilkMp 7mo ago

   Thanks for pointing it out! I had noticed some mapping issues (Russia's Military GDP not showing), so there is definitely room for improvement here. Just wanted to get this out there for people and create their own projects or use this
3. 3.▲
   by MilkMp 7mo ago

   Thanks! I am definitely not a front-end web designer lol, and I for sure don't want to limit people's access. I will look into the standards and see how best to implement them into the website :)
4. 4.▲
   by MilkMp 7mo ago

   Was originally just supposed to be a data archive/download place for the parsed data.Thought a website could help! Will look into the standards
5. 5.▲
   by MilkMp 7mo ago

   Thanks! Will look into it
6. 6.▲
   by MilkMp 7mo ago

   Just the start, but I added the maps to the page. Planning on linking them to their factsheets and dashboards this week. https://cia-factbook-archive.fly.dev/maps?page=1
7. 7.▲
   by MilkMp 7mo ago

   Hey there, yeah, definitely. I maintain .txt change logs for all data modifications. To be clear, no information is added or altered — the Factbook content is exactly what the CIA published. The parsing process structures the raw text into
8. 8.▲
   by MilkMp 7mo ago

   Will check out! Thank you!
9. 9.▲
   by MilkMp 7mo ago

   Hi there, thanks for linking this! My GitHub and website both link to and use this source! I just thought putting it in a SQL database and making the entire 1990-2025 queryable was needed since I couldn't find one anywhere :)
10. 10.▲
    by MilkMp 7mo ago

    Hi there! If you have anything you want added to the site, just let me know :) I can definitely try.
11. 11.▲
    by MilkMp 7mo ago

    Hi there, I have updated the webpage to include all countries/all years. It will give you a warning that the PDF is large. https://cia-factbook-archive.fly.dev/export
12. 12.▲
    by MilkMp 7mo ago

    Ohh that is a great idea! And since we already have the political field in SQL!. I will start working on some of this and update the website this week. Thank you for the awesome suggestions!
13. 13.▲
    by MilkMp 7mo ago

    Thanks so much!
14. 14.▲
    by MilkMp 7mo ago

    Found the problem, the total regex doesn't handle magnitude suffixes: 2018: total: 17,856,024 → parses as 17856024 (correct raw count) 2020: total: 18.17 million → parses as 18.17 (WRONG - drops "million") 2025: total: 39.3 m
15. 15.▲
    by MilkMp 7mo ago

    Found the root cause. The "World" entity (population ~8 billion) was being called alongside all individual countries, doubling the total. Thank you again!
16. 16.▲
    by MilkMp 7mo ago

    Will fix right now! I think I was looking at this for too long and missed some things. Thank you :)
17. 17.▲
    by MilkMp 7mo ago

    Hi there, I have located the root and sent out a bug fix. Root cause: The CIA World Factbook, published by the Central Intelligence Agency, uses the U.S. Government's FIPS 10-4 country codes, which differ from the ISO 3166-1 Alpha-2 co
18. 18.▲
    by MilkMp 7mo ago

    Hi there, I have located the root and sent out a bug fix. Root cause: The CIA World Factbook, published by the Central Intelligence Agency, uses the U.S. Government's FIPS 10-4 country codes, which differ from the ISO 3166-1 Alpha-2 co
19. 19.▲
    by MilkMp 7mo ago

    Hi there, I have located the root cause and will be fixing the issue: Root cause: CIA uses FIPS codes (CanonicalCode), which differ from ISO Alpha-2 for many countries. Templates and SQL queries prioritized CanonicalCode over ISOAlpha2, so
20. 20.▲
    by MilkMp 7mo ago

    Hi there, will fix Thank you! Most likely a grouping problem due to the MasterCountry ID.
21. 21.▲
    by MilkMp 7mo ago

    All good. Needed to be scaled anyway:)
22. 22.▲
    by MilkMp 7mo ago

    Will fix. Thank you! Most likely a grouping problem due to the MasterCountry ID.
23. 23.▲
    by MilkMp 7mo ago

    Thanks! Will update soon.
24. 24.▲
    by MilkMp 7mo ago

    Originally, my plan was just to create the archive, but I have expanded the scope, lol.
25. 25.▲
    by MilkMp 7mo ago

    I'll start working on this now! Thank you for sending it! It will be interesting to see if I can incorporate them into the globes or when the country info pops up!
26. 26.▲
    by MilkMp 7mo ago

    Hey, what features would you like to see??
27. 27.▲
    by MilkMp 7mo ago

    Will scale the website
28. 28.▲
    by MilkMp 7mo ago

    The data from the CIA World Factbook is in the public domain (being a U.S. Government work) and is free for anyone to use. The ETL scripts and data tools available in the GitHub repository are open source and licensed under the MIT License.
29. 29.▲
    by MilkMp 7mo ago

    Glad I was able to get the original fact book data that other archivists have gathered over the years- Project Gutenberg (plain text), Wayback Machine (HTML zips and factbook.jsons, and one from the agency's websites
30. 30.▲
    by MilkMp 7mo ago

    Will add to this once it's out. Thanks for sending this :)