5 ms·
Generally it looks like: unstructured mess -> CSV -> database, or mess -> structured intermediate format -> whatever. Or database -> nicely formatted report tha
by zapperdapper 8y ago
Generally it looks like: unstructured mess -> CSV -> database, or mess -> structured intermediate format -> whatever. Or database -> nicely formatted report that makes CEO look good. Even structured (weird XML) -> sort of structured (XHTML).
There was no generic solution although I've ended up reusing a lot of code.
One of the first gigs I got was to process about 7,000 pages from a static website, scrape out the relevant data, and plonk it in a database so they could run queries on it. :)
You could probably latch onto a common use case and build a solution for that e.g. Blogger to Wordpress transfer - something I've had to do in the past by building some custom tools. (That was years ago though - I've not looked at current state of play with regards tool availability). Not suggesting that would be your use case though - just an example.