Objective
Understand the demand of analytics jobs
a. What is the trend of demands for analyst?
b. Which location/industry the demand come from?
c. What degree is required to launch job in analytics?
d. What skills are needed in the analytics jobs?
Approach
Data Source
ExtractedFeatures
● Job Title● Company Name● Company Type● Company Industry● Job Location● Key Skills (SQL,
Python, etc)● Degree
Web Scrape
Database
TextMining CouchDB
NoSQL DB
Second Hand Data
First Hand Data
Indeed Trend Search
Definition
What do we mean by “analyst”?
Analyst
Data Analyst(Engineer)
Business Analyst(Business)
Match Keywords
data engineer, data scientist, machine learning, technical analyst, system analyst,
security analyst, data modeler, data architect etc.
Match Keywordsbusiness intelligence,
business analyst, program manager, product manager, marketing,
and other analysts not categorized asdata analyst (engineer)
who is responsible for designing algorithms, softwares, or infrastructure that enable analysis
who is responsible forconducting decision-related analysis
and communicate w/ client
Business Analyst (Business) is four time as much as Data Analyst (Engineer)
4,000+
16,000+
* Number of Active Job Posts on Linkedin Given the Pre-selected Keywords
“Analyst“ position shifts title over time
Data Scientist
Data Analyst Business Analyst
Business Intelligence
Demand for Business Analyst and Data Analyst are slightly different across industries
Top1 for Both Role
* which industry the job belong comes from the Linkedin company profile page
Data Analyst (Engineer) has higher preference towards Ph.D than Business Analyst (Business)
65% jobs express degree requirement
65%
% of Job Mentioning BS/MS/Phd
18%PhD Only
Data Analyst has more specific skills requirement than Business Analyst
Data Analyst(Engineer Side)
Business Analyst(Business Side)
3.0 1.3
# of Skills Required in the Job Post
* Among the extracted skill set, on average, data analyst position requires 3.0 skills while business requires 1.3 skills
SQL is the most important skill for Analyst (Engineer) as Excel for Analyst (Business).
SQLHigh for Engineer
ExcelHigh for Business
Java, Hadoop, PythonR, SAS, Machine LearningModerate for Engineer
PresentationModerate for Business
What is the trend of the demandfor those high/moderate skills?
Python R Machine L’ning
Hadoop SAS Java
Excel Presentation SQL
What about the trend for the skill
Business Engineer
High Moderate High Moderate
Excel Presentation SQL Python, R, ML, Hadoop SAS, Java
Takeaway
For Staffing and Recruiting Company:
1. Monitor skills instead of job titles
2. Focus on “Business Analysis” if the company want to
expand business in eastern coast
3. Help candidates prepare interview by helping them
enhance top required skills (SQL, Presentation)
The skill requirement of analyst is very diverse - not a skills satisfy more than half of the jobs
Top 20 Skills for Analytical Positions
NO skill can satisfy the requirement of
more than 35% jobs
Limitations/Next Steps
Limitations
1. Single Source: Job data is only from single source (only Linkedin)
2. Only June/July data could be crawled, no time series analysis could
be done with our own data
3. No way to detect job duplication (single job, multiple posts)
Next Step
1. Scrape data from multiple sources (indeed, monster)
2. Run the script weekly so calculate job data over time
3. Calculate the similar of two job posts to reduce duplication
4. Store the job into MySQL database
Top Related