Data pipeline technology is a kind of software/tool which takes certain steps to transport data from one location to another, such as moving data from GIPL DC to Cloud Storage or from one location to another.

The said software/tool is responsible to manage smooth transition from one location to another while maintain the data security & integrity.

In a standard term, data pipeline breaks huge data into smaller chunks for better data processing (In transit & @ Rest). Here, data pipeline is mainly used for huge data analytics/data warehousing applications such as hadoop, which runs batch processing jobs to process large amount of data.