Research Web Scraping ECI Labour Market

The ECITB wishes to appoint a provider to fulfil its requirement for a research project to develop comprehensive labour market intelligence for the Engineering Construction Industry by using web scraping techniques to analyse job advertisements from online platforms.

This project seeks to:

• Understand the evolving skills landscape within the ECI sector.

• Map the geographical and sectoral distribution of skills demand.

• Provide evidence-based insights to support workforce development strategies.

The following objectives will guide the research:

1. Identify which vacancy platforms ECI employers use.

2. Develop and implement web scraping algorithms to extract job posting data from Indeed, Glassdoor, LinkedIn and other platforms.

3. Create and enhance an occupational and skills taxonomy for the ECI built upon SOC codes with additional ECI-specific classifications.

4. Analyse the extracted data to identify skills gaps, emerging skills requirements and high-demand occupations across regions and sectors.

5. Quantify occupational shortages and estimate occupational demands across ECI sectors and regions.

6. Produce periodic reports and dashboards to inform ECITB's stakeholders.

7. Look at the educational pathways of the five most in-demand vacancies.

Full details of the requirements can be found within the detailed specification.

The initial Contract term will be for six (6) months, with an optional extension of three (3) months, commencing late August 2025.

The full procurement pack consists of the following documents which are available for download here on Find a Tender Service:

1. Invitation to Tender (ITT) - includes full guidance on the procurement process

2. Specification

3. Pricing Schedule

4. ECITB Services agreement (Contract)

***Tenderers should register their interest in the ITT via procurement@ecitb.org.uk after download of the documents from Find a Tender Service, to ensure they are included in the clarification process ***

We thank you for your interest in the ECITB and this opportunity.