Why should one use Karnataka Data Lake (KDL)?
KDL for Data Engineers: Data teams from different departments can plug in their raw data, and store/modify/transform the datasets on the platform without the hassle of multiple files. Karnataka Data Lake acts as a shared repository handling large amounts of data in various formats, with pre-built pipelines to clean/process, embed LGD codes, and join multiple tables in order to draw actionable insights from the data.
More details here : https://kdldashboard.iiitb.ac.in/
KDL for Analysts: Analysts can identify and observe the trends/patterns in the data or join datasets from different departments to get a bigger picture in solving a problem. They could perform data analytics by utilizing visual representations such as tabular views, graphs, and charts. Karnataka Data Lake’s pre-built module on Exploratory Data Analytics provides initial reports, observations, and correlations from user-selected datasets and has the ability to perform real-time analysis using AI/ML models. Some of the data stories can be found below:
KDL for Policy Makers/ Researchers: Policy Makers can utilize Karnataka Data Lake with a focus on intervention modeling and counterfactual analysis to understand potential causes that provide clues on how, when, and where to intervene with policy instruments so as to achieve targets/goals in the best possible way. These models are developed by combining domain knowledge with expert opinion along with reliable sources like journal articles, government reports, etc. to learn dependency parameters. They serve as our best bet in accommodating uncertainty and geospatial data analysis.