ETL and ELT courseLesson 3 of 14
ETL and ELT course · Lesson 3 of 14
ETL Tools Explained: Types, Examples and How to Choose
The main types of ETL and ELT tools (ingestion, transformation, orchestration, all-in-one), common examples of each, and a practical checklist for choosing.
On this page
An ETL tool helps you extract data from source systems, transform it into a useful shape, and load it into a destination such as a warehouse or lake. In practice there is no single “ETL tool” that does everything best. Modern data teams usually combine a few tools, each good at one part of the job.
This lesson sorts the landscape into categories so you can recognise any tool you meet, and ends with a checklist for choosing.
The main categories
| Category | What it does | Examples (not a ranking) |
|---|---|---|
| Managed ingestion (ELT connectors) | Ready-made connectors copy data from apps and databases into the warehouse on a schedule | Fivetran, Airbyte Cloud, Stitch, Hevo |
| Open-source ingestion | The same, run on your own infrastructure | Airbyte (open source), Meltano, dlt |
| Change data capture | Streams row changes from database logs | Debezium, cloud database migration and replication services |
| Transformation | Turns raw tables into clean models, usually with SQL | dbt, SQLMesh, warehouse-native tasks |
| Distributed processing | Code-based transformation of very large or complex data | Apache Spark (Databricks, EMR, Dataproc), Apache Flink |
| Orchestration | Runs the steps in order, retries, alerts | Apache Airflow, Dagster, Prefect, AWS Step Functions |
| Cloud all-in-one / visual | Drag-and-drop pipelines with connectors, mapping and scheduling | Azure Data Factory, AWS Glue, Google Cloud Data Fusion, Microsoft Fabric pipelines |
| Enterprise integration suites | Long-established platforms with governance and many connectors | Informatica, Talend, IBM DataStage, Oracle Data Integrator, SSIS |
The categories overlap. AWS Glue has a catalog, crawlers and Spark jobs; Azure Data Factory has connectors, mapping data flows and scheduling; Databricks offers ingestion, Spark and job orchestration in one platform.
A typical modern stack
A common combination for analytics in the cloud:
- Ingestion: a connector tool (managed or open source) loads SaaS and database data into raw tables. CDC handles large, busy databases.
- Transformation: dbt builds staging, core and mart models inside the warehouse, with tests. This is the “T” of ELT.
- Heavy processing: Spark jobs handle the few datasets too large or too complex for SQL.
- Orchestration: Airflow or a similar tool runs the steps in order and alerts on failures. See what data orchestration is.
Older on-premises setups often use one enterprise suite for all of these. Many companies run both during a migration.
Code-first vs visual tools
| Code-first (Python, SQL, dbt, Spark) | Visual (drag-and-drop) | |
|---|---|---|
| Version control and review | Natural: everything is text in Git | Possible, but often exported as large JSON or XML |
| Testing | Unit tests, data tests, CI | Usually limited |
| Learning curve | Needs programming skills | Faster for simple pipelines |
| Complex logic | Handles anything | Can become hard to follow |
| Who maintains it | Engineers | Engineers and technical analysts |
Most data engineering job descriptions ask for code-first skills (SQL, Python, dbt, Spark, Airflow), plus familiarity with one cloud’s visual tool.
How to choose: a checklist
- Sources and destinations. List the systems you must connect. A tool with ready, well-maintained connectors for your sources saves months.
- Volume and freshness. Daily batches of gigabytes and second-level streams of terabytes need different tools.
- Batch or CDC. Large, busy databases need log-based CDC, not repeated full extracts. See CDC patterns.
- Team skills. A SQL-strong team gets the most from dbt; a Python-strong team can own Spark and custom connectors.
- Managed vs self-hosted. Managed tools cost licence fees but save engineering time; open source costs engineering time but no licences.
- Cost model. Pricing by rows, by active rows, by compute time or by connector behaves very differently as data grows. Model your expected volume before signing.
- Security and compliance. Where data travels, which network paths are needed, and how credentials and personal data are handled.
- Lock-in. Prefer tools that write to open formats and keep logic in code you own.
Run a short proof of concept with your two hardest sources before committing.
Common mistakes
- Choosing by popularity instead of by connector coverage for your own sources.
- Building custom connectors for common SaaS apps when maintained ones exist.
- Putting all business logic in an ingestion tool, where it is hard to test and review.
- Ignoring how cost grows with volume, then facing a surprise renewal price.
- No orchestration or monitoring, so failures are found by dashboard users.
What interviewers look for
For “which ETL tools have you used?” or “how would you choose an ETL tool?”:
- The categories, with an example of each, and that real stacks combine them.
- What you used, why, and one limitation you hit.
- The selection criteria above, especially sources, volume, skills and cost.
- Where ETL vs ELT fits, and where orchestration sits.
Practise with the data engineering interview questions.
Key takeaway
ETL tools fall into categories: ingestion connectors, CDC, transformation, distributed processing, orchestration, cloud visual tools and enterprise suites. Modern stacks combine a connector tool, dbt for transformation, Spark where needed and an orchestrator. Choose by your sources, volume, team skills, cost model and security needs, and test the hardest sources first.
Progress is saved in this browser only. No account needed.

