The Emperor Of All Remedies: Big Data

Big Data Studio

05 Jan 2013 — By Fari Payandeh

The thickening line of optimism wrapping around the vector of time is a harbinger of what is to come. As I was browsing through the Big-Data-related articles that I had collected in 2012, I couldn’t help but noticing the positive trend in the way the world is viewing it. Nonetheless, a chorus of voices, conveying a message of admonishment has been reverberating through the corridors of academic and scientific communities. The gap between the overly optimistic business world and the prudent scientific world is primarily created by the forces that have stumbled into a delicious opportunity for making huge profits. They see Big Data as a low hanging fruit and they are working around the clock to promote it. Some of these “experts” don’t have the foggiest idea of what’s under the hood. “Something true when whispered becomes false when shouted”, and that is part of the problem. On the opposite pole, some scientists wrongly assume that Big Data is just another fad and it will collapse under its own weight. I believe that the current state of this technology is the most sensitive barometer for measuring its future potential. However, the technology has two arms, albeit inextricably intertwined, working on two different requirements. Big Data’s first arm came to life out of operational necessities after some Web 2.0 companies hit an impasse while utilizing traditional RDBMS technology. The second arm, the analytics, already existed in the IT industry, but needed a transplant to give it Business Intelligence capabilities. The operational arm has been successfully implemented by companies like Facebook; Facebook ingests around 500 TB of data per day– an astonishing value compared to traditional Data Warehousing limits. The evidence abounds that the operational capabilities of Big Data are indisputable.

Now, let’s examine the point of contention, which is Big Data Analytics. No one questions the value that analytics might bring to businesses. The rift is caused by the disagreements over the practical aspects of creating value, and not its merits.  Here is a good example of what is under scrutiny: How are we going to derive insight from bad data? Many companies are grappling with making sense of the operational data they have collected, let alone distilling raw data into intelligence. With that in mind, there are companies that have succeeded in increasing revenues and reducing costs as a result of implementing Big Data Analytics. As the world becomes one huge Network– one entity one IP address— arena, connecting billions of devices, and as more and more sensors are implanted in “things”– appliances, buildings, offices, homes, vehicles, factories, medical devices, and big machineries, we will witness a societal  metamorphosis. Just as breaking the sound barrier unleashed the forces that changed the world in terms of air travel and warfare, breaking the data size barrier will inevitably change the world in terms of making it a SMART place. Does it mean that every company that sits on top of large amounts of data will directly benefit from this new technology? The answer is No. Is Big Data going to change the world as we know it? The answer is a resounding Yes, but it will take some time for Big Data’s true identity to be revealed.

21 thoughts on “The Emperor Of All Remedies: Big Data

  1. I really like the chengas you’ve made here and recently installed the latest version. However, I just called load.project’ in an older project directory only to be reminded that config/global.yaml’ is not present. It’s easy enough to copy the new directories into my old project, but you might consider adding a function to update old projects to make it quick and transparent.Also, I have a number of scripts in src/ that I usually want loaded at the same time as I run load.project()’. That is, they’re functions that I’m actively developing, but the next step after calling load.project() is usually to load these so I can continue development. I previously had these source commands in lib/load_libraries.R (as a bit of a kluge). Did you have a plan for auto-loading stuff in src/ or is that contrary to your intended usage?

  2. พูดว่า:Hi there,Im quite joyful to get so ufeusll data online. It is by far 1 of my favorite internet websites so you’ve got my respect. Bookmarked your web page so Im free to come again for much more. Retain up beneficial get the job done!

  3. Hyderabadsys online training main aim achieving is students who want learn our training intistitusion give ever best training & good online teaching with live projects. so Hyderabadsys hadoop online training have superb trainer to the students Hyderabadsys hadoop Online Training on the web training give a best training for hadoop in India. so we’re prepared to give best training to students. so student have any doughtas easily can clarify.
    INDIA+91 9030400777
    USA +1-347-606-2716

  4. I was wondering if you ever thought of changing the
    page layout of your site? Its very well written; I love what youve
    got to say. But maybe you could a little more in the way of content so people could connect with it better.
    Youve got an awful lot of text for only having 1 or 2
    pictures. Maybe you could space it out better?

  5. Good day! I know this is kinda off topic
    however I’d figured I’d ask. Would you be interested in exchanging links or maybe guest writing
    a blog post or vice-versa? My blog addresses a lot of the same
    subjects as yours and I feel we could greatly benefit from each other.
    If you are interested feel free to send me an e-mail. I look forward to hearing from you!
    Wonderful blog by the way!

  6. Hmm is anyone else experiencing problems with the pictures on this
    blog loading? I’m trying to determine if its a problem on my end or if
    it’s the blog. Any suggestions would be greatly appreciated.


Fill in your details below or click an icon to log in: Logo

You are commenting using your account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s

This site uses Akismet to reduce spam. Learn how your comment data is processed.