Government | Big Data Republic

Sponsored by:

|

Financial Services



	Latest Comments 5/23/2013 10:37:19 AM a.saji @netcrawl: Yes it is a headache but we cannot do anything other than blocking but for that also we should know the sender address. &n... Blogs 9 Big Email Data: Junk or Treasure? Robert Plant, Associate Professor, School of Business Administration, University of Miami, 5/22/2013 Comment now Most of us think we have a big data set related to our email storage; I personally have about six gigabytes of email. The business school where I reside has about 3 Terabytes of live email storage containing emails going back to around 1995, when we moved to Windows NT. However, this is just a drop in the proverbial email ocean when compared to some ... Most recent post, a.saji, 5/23/2013 10:37:19 AM @netcrawl: Yes it is a headache but we cannot do anything other than blocking... 6 Big Data Is a Big Mystery to Local Governments Robert Mullins, Technology Journalist, 5/14/2013 Comment now A newly-released survey shows that the US government is gradually gearing up to develop systems to analyze big data stores to make government more efficient, but that state and local governments in the US are way behind. Not even a conversation Forty-four percent of state and local governments aren't even discussing a big data analytics project, ... Most recent post, Saul Sherry, 5/15/2013 1:10:34 PM Sam, seems to be a bit of an East Coast lean on those cities... coincidence? I... 18 Want to Move Off the Big Data Information Grid? Robert Plant, Associate Professor, School of Business Administration, University of Miami, 5/8/2013 Comment now State-run big data projects are in the news. CISPA and the IRS are trying to monitor our personal data and build big data solutions at the national level. The FBI, MI6, Mossad, and the Russian SVR, among other intelligence agencies, exchange information with one another through technology services such as the NSA and GCHQ. Most recent post, Daniel Gutierrez, 5/14/2013 12:53:43 PM @Saul, Gibson's concept of cyberspace, or what others call the "Matrix" is slowly... 15 Fighting Human Trafficking With Big Data Ariella Brown, Technology Blogger, 5/6/2013 Comment now When we think of slavery, we think of something that has been eradicated from modern civilization. But the fact remains that nearly 21 million people around the world are effectively enslaved. Most recent post, Ariella, 5/8/2013 1:32:08 PM @Debera I assure you, I wasn't offended. I just want to stress that people shouldn't... 9 Big Data of Birding Daniel D. Gutierrez, Data Scientist, 5/2/2013 Comment now The effects of big data have touched many areas of human endeavor in a relatively short period of time, so I wasn't completely surprised to learn how it has affected another quaint little segment of society -- birding enthusiasts. Most recent post, Saul Sherry, 5/7/2013 12:15:23 PM You should tweet that one out @TheSocialPitt... oh lord, this is getting worse. 17 The Pentagon's Big Data Research Push Peter Buxbaum, Journalist, 4/30/2013 Comment now The United States Department of Defense and the intelligence community are going to be spending more on big data initiatives next year, if, that is, the Obama administration has its way. Most recent post, SharCo, 5/6/2013 3:23:31 AM It will be interesting to peruse these case studies if or when they become available.... 16 The Data Within: Taxes & the Future Mike Lata, Freelance Writer, 4/29/2013 Comment now There are many apps available to help us with our taxes, but these apps may come with data-collecting features. This has worried some privacy advocates. According to PC Magazine, a lot of these apps are sharing geolocation data, contact information, and other user data with third parties. This data is used for targeted advertisements. Most recent post, SharCo, 5/6/2013 2:50:15 AM True, Netcrawl. It was only a matter of time before data from apps grew to this... 32 What Does Big Data Say About Sleep Needs & Space Missions to Mars? Susan Fourtané, Science & Technology Writer, 4/26/2013 Comment now Anyone who has experienced insomnia, or any other form of sleep disorder, knows that having a good night's sleep allows you to function properly with a rested body, good mood, and an alert mind the next day. Indeed, both quality and quantity of our sleep have a great influence in our bodies, especially in the nervous system and the mind. Most recent post, a.saji, 5/15/2013 10:49:12 AM @Susan: Plus most importantly the risk is not thee anymore. So then you can try... 15 CISPA: Information Without Representation? Robert Plant, Associate Professor, School of Business Administration, University of Miami, 4/24/2013 Comment now The Cyber Intelligence Sharing and Protection Act (CISPA), working through the US legislative system, is developing into a highly controversial law, and the first real test of governmental big data gathering power. Most recent post, kiran, 4/29/2013 12:12:39 PM @smkinoshiat - You're right. CISPA did have multiple facets. It basically let organizations... 9 Weather: Big Data & Big Business James M. Connolly, US Correspondent, 4/22/2013 Comment now You probably don't think about big data analytics having roots in the middle of the 19th century, but consider that, at their core, these projects collect data from a lot of different sources and help analysts establish patterns and even draw some pretty solid conclusions. Most recent post, James M. Connolly, 5/8/2013 3:33:01 PM @LegalCIO. Good point about the CIA leveraging the private sector. The irony... 4 Your Introduction to Predictive Analytics & Big Data Istvan Szegedi, IT Technical Architect, Vodafone UK, 4/18/2013 Comment now Predictive analytics allows companies to reduce risk, supports more attractive customer experience, and instills better decision making. It is used in financial services, insurance, telecommunications, healthcare... you can name the rest of the industries. Most recent post, MDMConsult, 4/19/2013 9:03:14 PM Any business should have strong optimization plans for predictive analytics for... Next 5 blogs + All blogs All blogs most commented 9 Big Email Data: Junk or Treasure? Robert Plant, Associate Professor, School of Business Administration, University of Miami, 5/22/2013 most commented last month 32 What Does Big Data Say About Sleep Needs & Space Missions to Mars? Susan Fourtané, Science & Technology Writer, 4/26/2013 Video Blogs Big Data Explained: What ... 8 comments More Video Blogs Message Boards 5/23/2013 10:37:19 AM Re: It Can Be Junk For Someone And Treasure For Some One : @netcrawl: Yes it is a headache but we cannot do anything other than blocking but for that also we should know the sender address. a.saji on Big Email Data: Junk or Treasure? 5/23/2013 8:53:04 AM Re: Junk: @netcrawl. Right, Email remains important from a forensic point of view, as you note in the Lehman case. However, just in day to day corporate activity it has revolutionized how we do business. You can get a message/query to anywhere from one... James M. Connolly on Big Email Data: Junk or Treasure? 5/23/2013 2:55:46 AM Re: Junk: @James its still best corporate communication tool (that's for me), especially in high technology and financial industry. Email is very important, it contained "precious data", in handling litigation around corporate meltdown (remember Lehman... netcrawl on Big Email Data: Junk or Treasure? 5/23/2013 2:46:27 AM Re: It Can Be Junk For Someone And Treasure For Some One : @debera I agree with you, it sreally true email junk is a big headache when it comes to management, it consumed almost 50% of your inbox. It could ruin your office works. You need to junk them one by one, to remove them in your daily lists.... netcrawl on Big Email Data: Junk or Treasure? 5/22/2013 7:40:17 PM Re: Junk: @ariella. There's real value in knowing when to leave an email thread and go to an inperson or phone conversation. In fact there are some things that are better off not done completely in email (personnel matters in particular). However, the... James M. Connolly on Big Email Data: Junk or Treasure? 5/22/2013 7:36:20 PM Re: Junk: @Legalcio. I'm on record (and have the email to prove it) that I hate the idea of storing tons of stuff "just in case" it comes in handy down the road. I say that despite all the stuff clogging my toolshed and spare bedroom. That said, I'll... James M. Connolly on Big Email Data: Junk or Treasure? 5/22/2013 5:50:16 PM It Can Be Junk For Someone And Treasure For Some One : Almost 70 percent of the inbox usuall gets filled with the junk mails but the question is this that who sends these emails definitely these emails are the adds by the marketers . It ca be junk for you but it is not junk for them... Debera Harward on Big Email Data: Junk or Treasure? 5/22/2013 2:25:07 PM Re: Junk: <A lot of email could be eliminated by not using systems for personal communication, non business communication, or creating endless threads where a 5 minute phone call would suffice.> @legalcio I agree! But there are people who will... Ariella on Big Email Data: Junk or Treasure? 5/22/2013 10:41:36 AM Junk: Most of it is junk. Mindless yes or no responses, threads about your kid's birthday party, laments about the final episode of The Office. Then there is that one piece of mail containing a cryptic message about a package that needs delivery... legalcio on Big Email Data: Junk or Treasure? 5/18/2013 11:20:10 PM Re: Increased TTA leading to increased error rate?: @Saul: Not really but that will help them to study the market and re-adjust based on the fresh needs. a.saji on Big Data Value & the Rise of Time to Answer 5/18/2013 10:58:46 PM Re: Increased TTA leading to increased error rate?: keith you are absolutely correct interpretting and analyzing the data is one of the most impornat point. Just collecting data and not interpretting it correctly is just useless .Collecting the data ,doing analysis and interpretting it and then... Debera Harward on Big Data Value & the Rise of Time to Answer 5/15/2013 1:10:34 PM Re: Long slog but being done already: Sam, seems to be a bit of an East Coast lean on those cities... coincidence? I guess mayors have enough on their plates keeping voters happy, dealing with pressure groups -- but the big data and open data use is only going to get stronger... Saul Sherry on Big Data Is a Big Mystery to Local Governments Next 5 messages + All messages All messages Chat		Flash Poll All Polls Follow @BigDataRepublic LinkedIn RSS Data Visualization Showcase Financial Political Sentiment in Social Media Tableau visualizes political sentiment, focusing on feelings about finance, in the runup to this year's US Election. Explore this data here. More Data Visualization Showcase BDR in your Inbox Like Us on Facebook Follow Us on Twitter Accolades

Big Data Republic

|

|

|

|

|

|

|

UBM Tech

UBM TECH

To save this item to your list of favorite Big Data Republic content so you can find it later in your Profile page, click the "Save It" button next to the item.

If you found this interesting or useful, please use the links to the services below to share it with other readers. You will need a free account with each service to share an item via that service.
Tweet This
[close this box]

Saul Sherry
Big Data Explained: What Is Pig?
Part of 9 | See complete series
3|21|13 | 1:16 | (8) comments

Pig basically simplifies the processes needed to get analytics done through Hadoop on your big data sets.

Like the animal, Pig is not a fussy eater, getting its name from its ability to crunch through data, no matter what form it takes. It acts as a scripting interface to Hadoop, meaning a lack of MapReduce programming experience won't hold you back.

Example: Harvey works in a government office, looking to formulate new solutions for his city's parking problems. He knows how to use data, but writing his own mapper and reduce functions is a little beyond him.

Luckily, he's been set up with access to the databases through Pig, meaning he can draw on sources like parking ticket records and population density maps. Taking advantage of Pig's eat-anything attitude, he can also mine topics from a call for email suggestions his department sent to local residents, as well as sensor information about the amount of traffic on the roads. In spite of his limited programming capabilities, Pig allows Harvey to query these data sets and sketch out some draft suggestions he can use to alleviate the local parking problems.