You know you have a data talent shortage on your hands when Yahoo is busy buying up companies just for their talent.
With 90 percent of the world’s data created in the past two years (according to IBM), there is a huge volume of data available to companies that want to translate this information into actionable insights. However, is there a big enough talent pool of data scientists, who have the business acumen to make company decisions?
Michael Koploy, BI solutions analyst for Software Advice, and icrunchdata Co-Founder Todd Nevins sit down to discuss the growth of big data jobs in the past six months and how the demand for data scientists is expected to increase throughout the next year to two years. They also cover how today’s top startups and large enterprises are overcoming the challenge of finding top talent while universities scramble to update their curricula with a data science field of study.
User Rank: Exabyte Executive 11/1/2013 | 8:28:51 PM
Re: High demand results in unfounded job descriptions @Saul Agreed. It seems experience is seriously needed. Today's strategic decisions are hevily based on analytics. A great combination would be bridging real world experience, traditional and innovative skills.
Re: High demand results in unfounded job descriptions @Saul, I think the recruiters and HR people are simply reacting the best they can to address the new requirements of the Data Scientist position. But to be clear, it is not the norm to suddenly have such a new job description that is in such high demand. Over time I believe, there will be a greater sense of what to expect from this position and settle into reality.
User Rank: Exabyte Executive 10/30/2013 | 9:17:05 AM
Re: From Good to Great @Saul: Funny you mention that -- the book notes that the transition from Good to Great takes awhile, and sometimes the process included just "waiting out" embedded staff. Most tactics involved changing the working environment in some way (including just putting more focus on the right staff) so the wrong staff would simply leave on their own.
Re: High demand results in unfounded job descriptions @Saul, i agree with you, that's why i am of the opinion that instead of making any fancy job description it is necessary to look at the functions or skills bare minimum to carry out the operation and the candidate should have the courage to dig the details on their own and they should have high ability to learn and unlearn things by doing multiple experiments. At the end of the day its experience and training not the education matters in a real world scenario.
User Rank: Blogger 10/30/2013 | 6:33:38 AM
Re: From Good to Great @Smkinoshita - sounds pretty comprehensive then. I wonder what the split is like on this US vs the rest of the world. I think it's a little easier to 'get rid' of the wrong staff in the states, probably lending itself to more innovation in this space.
User Rank: Blogger 10/30/2013 | 6:30:53 AM
Re: High demand results in unfounded job descriptions @Pradeepta - It's time to stop pulling our hair out and worrying about the shortage and start hacking the missing skills so we can get results. Even when the first crop of 'university educated data scientists' spew into the real world there isn't going to be enough of them to fill the gap.
User Rank: Blogger 10/30/2013 | 6:26:09 AM
Re: High demand results in unfounded job descriptions Scary to think those HR departments are so under-prepared. So in the job you described, what percentage of the tasks described would actually form a part of their job?
Re: High demand results in unfounded job descriptions @Daniel, the courses offered through Coursera, edx and Udacity pertaining to data science are really very structured and specific to the requirements the companies are looking for. They really doing great in fulfilling the demand supply gap.
Re: High demand results in unfounded job descriptions Good point about universities working hard to revamp their degree programs. The alternative is to retool more quickly using the resources of MOOCs. For example, a great new class just started yesterday over at Coursera: Data Analysis, which also serves as an introduction to machine learning using R. I'm one of the Community TA's over there and the 8 week course should be a lot of fun.
Re: High demand results in unfounded job descriptions @Saul, I think you hit it on the head, the position is so new that HR, internal/external recruiters don't really know what the qualifications should be so they just Google "data scientist" and then copy/paste as many mysterious keywords they can find into the job ad. What this means is that the person/people interviewing candidates may not really know how to determine qualifications. This is why I, as an independent consultant, am often asked to help out with the hiring process for the beginnings of an internal data science staff.