DARPA wants algorithms that filter text for intel analysis

reply to post by rkseid


Thanks for reminding me!

Dugan has been somewhat of a polarizing figure at DARPA, where she has emphasized concepts like crowdsourcing of military technology and actual completion of projects, rather than just blue-sky research. She is also under investigation for contracts awarded to a company called RedX Defense, a bomb technology firm she co-founded and still partially owns. DoD officials said her departure is not related to that investigation.

Dubious procurement situations.... eh?

Director of DARPA Departs Pentagon for Google

DARPA Chief Departs Defense Department to Work for Google

The cronyism is astoundingly transparent.... isn't it?

Interesting articles are 'suddenly' making their way into the mainstream....

Could Sarcastic Computers Be in Our Future? New Math Model Can Help Computers Understand Inference

ScienceDaily (May 30, 2012) — In a new paper, the researchers describe a mathematical model they created that helps predict pragmatic reasoning and may eventually lead to the manufacture of machines that can better understand inference, context and social rules.

Predicting Pragmatic Reasoning in Language Games

One of the most astonishing features of human language is its capacity to convey information efficiently in context. Many theories provide informal accounts of communicative inference, yet there have been few successes in making precise, quantitative predictions about pragmatic reasoning. We examined judgments about simple referential communication games, modeling behavior in these games by assuming that speakers attempt to be informative and that listeners use Bayesian inference to recover speakers’ intended referents. Our model provides a close, parameter-free fit to human judgments, suggesting that the use of information-theoretic tools to predict pragmatic reasoning may lead to more effective formal models of communication.

Funny how DARPA works. What they need on the sly, they ask/partner for on the sly. Why go public with work that is obviously follow up from Butt Admiral John Poindexter's (total cockup of the) Total Information Agency?

Bet they already got what they need.

Originally posted by MemoryShock

It's not going to happen due to a very fundamental flaw in human contextual reasoning in those interpreting data expecting to find a problem and similar predispositions in the eventual coders.

The problem is based on the knee jerk reaction to the information age; that people of varying educational backgrounds are going to go hell bent rampaging because their expectations don't match reality. More likely, because the reality of basic Big Media communication (on politics for example) is to use psychological cues to invoke reactions. The internet is now a forum for the venting of those invocations and some of the danger this coding presumes to prevent has been shown to be created through FBI intereference/suggestion,

My point?

There is no absolute standard for applying a static formula to context.

No but there may be a quantum one.

I think as indicated, "greatly assist analysts " is all its all about though upto certain extent, the algorithms can be used to derive proven outcomes based on stats over the next few years but it will not be publicized. The human factor will still remain no matter what. A Lot of concepts that DARPA undertakes as R&D never really makes it to the DOD or Civilian Sector.

The way I look at it, the vast amount of data that is collected is simply too costly to be analyzed by humans as they need to hire translators with various languages based on what they are trying to decipher. If the algorithm 'assists the analyst', I'm sure they can cut back on lot of costly hours spent on some 6 Petabytes (Its a WAG..not sure what the current rate is) per month that is currently being collected. How many people do you think they can afford to hire to decipher all the information that is collected? Just imagine how much information can 1 person analyse in a day and how much staff would be required to go through all that information that is collected everyday.

Below is a WAG

Data_Rate_NSA

NSA_Data_Center

reply to post by Maxmars


Here is another link on the future of Data analysis by several agencies.

Whitehouse_Link

Originally posted by THE_PROFESSIONAL
Basically it is an algorithm that takes a large text and generates a human readable summary that is all it is.

Right. And they need a lot of summaries in Utah!

www.wired.com...

Originally posted by rkseid
Well, just to add my 2 cents worth:

Former DARPA chief Regina Dugan left DARPA and joined Google, now that is telling!

www.popsci.com...

Puzzling?

Not if you take into account she left at the same time Brant Stillings corroborated her presence with Obama in the Project Pegasus/Mars teleportation.

Dugan Mars