Profile cover photo
Profile photo
Aware Research
40 followers -
Search smarter and further through the flood of online information.
Search smarter and further through the flood of online information.

40 followers
About
Posts

Post has attachment
"I'm working on a framework to allow construction of large-scale analytical queries on unstructured data."

Huh. That's what we do every day at Aware Research.
Add a comment...

Post has attachment
"Every Sunday morning, millions of people in India tune in to watch Bollywood star Aamir Khan host one of the country’s highest-rated television shows, Satyamev Jayate. Only unlike so many popular programs, Satyamev Jayate doesn’t involve a singing competition or a collection of volatile strangers living under the same roof. It’s a documentary program tackling some of the country’s most-sensitive topics, and it has the whole country — indeed, the whole world — talking. In order to funnel millions of messages a week into something valuable, the shows producers have turned to big data."
Add a comment...

Post has shared content
#analytics #statistics #bigData #nlproc
Add a comment...

Post has attachment
In fact, far more data scientists work in the business world than in the halls of academia or think tanks. Data scientists can prove to be one of your most strategic assets in the competitive wars.

If you can uncover new patterns in customer sentiment before your rivals, then you can address them before the competition can even cobble together a clue. If you can adjust the media mix behind your digital marketing campaign in real time to ensure the right messages get to the right audiences, you can save the campaign, and possibly your company, from going down the tubes.
Add a comment...

Post has shared content
Why do we need Data Science?

Plenty of businesses already do what's called business intelligence (BI): aggregating and warehousing data, and reporting on it. Let's not underestimate how important this is. Just getting your own operational data into one place and reporting on it is no small task, and can reap big benefits. People from the BI world might be forgiven for thinking the big data and data science crowds are just reinventing, sometimes badly, what they've worked on for many years.

To some extent that's true. Many new technology waves reinvent the past, and they often do it poorly. Linux started just this way. So where's the value in the current waves of big data and data science?

There's no doubt that the big data part of things is hugely significant, and that's one half of the story. Massive sources of data can now be feasibly analyzed. But it's what you do with it that counts. You can still run the same old reporting on the top of big data.

The other half of the story is the "science," as it is this which enables new insights and new products. Science is about creating hypotheses, and setting out to prove or disprove them.

Why is the scientific method applicable to business and data?

Every company's business is complex in itself, and they operate in a complex world. The financial, economic and societal structures we live and do business in are complex. Because of this complexity and interactions, businesses can be viewed in the same light as organic, biological systems. They are complex entities within a complex system.

This is where science comes into play. Even assuming you could come up with a top-down mathematical model of your business, there's too much interaction and randomness with complex systems for your model to be practical. Thus, the exploratory approach of science becomes useful to a business.

Your world and business is a giant laboratory, and ever moreso as the world becomes more networked. By employing data scientists you can discover better how your business works, how it can be improved, and find new things you can do that you didn't know of before. To do this, you must connect up three kinds of people: the business folk, the data scientists and the data engineers.

It's about exploration

The thing that makes data science different from what has gone before is that it's about exploration and invention, not just reporting. It's about learning how to ask questions, rather than looking for a set of predefined answers.

The best data scientists are curious and entrepreneurial. They're the pioneers of the data ecosystem: making new discoveries and inventions that a business can turn into product and competitive advantage.
Add a comment...

Post has attachment
"The KDD Cup is the world's foremost data mining competition. It's an annual contest that challenges data scientists to find out what they can learn from a given dataset. Previous competitions have used data in areas ranging from particle physics to customer relations. This year, they're looking for something particularly meaningful: a data problem in an area such as medicine, education, the environment, or anything that leads to a social good.

The deadline is approaching, and they're still looking for good candidates The competition will be hosted by Kaggle, so if your submission wins, you don't have to worry about logistics; all you need to do is supply the data, and one or two well-defined problems that you expect the data to solve. Then sit back and wait for the solutions to roll in."
Add a comment...

Post has attachment
Apache Tika is a one-stop shop foridentifying, retrieving, and parsing text and metadata from over1,200 file formats including HTML, XML, Microsoft Office,OpenOffice/OpenDocument, PDF, images, ebooks/EPUB, Rich Text,compression and packaging formats, text/audio/image/video, Java classfiles and archives, email/mbox, and more.
Add a comment...

Post has attachment
In the past few years, sentiment and mood analysis have become mainstays in the defense and intelligence communities. Last October, an Electronic Frontier Foundation lawsuit revealed how the Department of Homeland Security has carefully monitored a variety of public online sources, from social networks to highly popular blogs like Daily Kos for years, alleging that "leading up to President Obama's January 2009 inauguration, DHS established a Social Networking Monitoring Center (SNMC) to monitor social-networking sites for 'items of interest.' "In August, the Defense Advanced Research Projects Agency (DARPA), invited analysts to submit proposals on the research applications of social media to strategic communication. DARPA planned on shelling out $42 million in funding for "memetrackers" to develop "innovative approaches that enable revolutionary advances in science, devices, or systems."
#analytics #socialMedia #sentimentAnalysis #opinionMining
Add a comment...

Post has attachment
We can relate to this. #analytics
Add a comment...

Google Plus pages is now live so we can share news and insights on text-mining, natural-language processing, web automation, data-extraction, visualization and other data-geekery!

[And how it applies to stuff like marketing research, event promotion, competitive intelligence, prospect and lead generation, data-journalism, website monitoring, opinion-mining, product and technology tracking…]
Add a comment...
Wait while more posts are being loaded