It looks like you're using an Ad Blocker.
Please white-list or disable AboveTopSecret.com in your ad-blocking tool.
Some features of ATS will be disabled while you continue to use an ad-blocker.
Normalizing the Data
Once you have the feeds, you normalize the data into a format that you can easily work with. This may mean inserting the entries into a database as rows or storing them in some other format. Storing in XML is a possibility, but you'll have to use additional XML processing tools to gather the data, incurring a lot of overhead for processing and complexity. I find it most useful to rip the data from the feeds into a small database and then re-extract it for analysis. This strategy allows me to select a fixed number of stories for analysis and also to store the data over time for more long-term analysis.
(I think we're going to need more PODmods.)
a researcher in this field, says there are five such principles: more members create differences, ignorance of individuals is useful, random encounters should be encouraged and individuals must look for patterns in the signs and pay attention to their neighbors.