Overall responsibility is to provide analytics-ready data to data consumers.
Data is analytics-ready when it is
- accurate
- reliable
- complied to regulations
- accessible to consumers
Data Engineers
- extract, organize and integrate data from sources
- prepare data for analysis and reporting by transforming and cleaning
- design and manage data pipelines from source to destinations
- setup and manage infrastructures for ingestion, processing and storage of data
Functional skills of Data Engineer include the ability to
- convert business requirements to technical specifications
- work with SDLC
- understand potential application of data in business
- understand risk of poor data management