Skip to content

How to install blipdataforge

The blipdataforge package is available across many Databricks workspaces around Blip. So, you likely already have access to blipdataforge. All you have to do, is to import it into your notebook:

import blipdataforge

The above command should work fine on most Databricks workspaces. But in case you want to know for sure if the blipdataforge package is available for your specific Databricks workspace, checkout the Avaiability in Databricks section.

On the other hand, if you want to run blipdataforge locally in your computer, then, you must follow the steps outlined in the How to install BlipDataForge locally section.

Availability in Databricks

Please note that the blipdataforge library is not available in all Databricks workspaces and clusters, so it's essential to pay attention before starting your coding.

Currently, the library is available in any cluster from the workspaces:

  • dbw-clients-dev-brazilsouth
  • dbw-clients-prd-brazilsouth
  • dbw-dageneral-dev-brazilsouth
  • dbw-dageneral-prd-brazilsouth
  • dbw-rdproduct-dev-brazilsouth
  • dbw-rdproduct-prd-brazilsouth
  • analyticsbricks

How to install BlipDataForge in your Databricks workspace

If the blipdataforge library is not available yet in your Databricks workspace, send a message to Blip Data Platform crew, asking them to install the library in your workspace.

Team Email: dataplatdevelopment.da@blip.ai Team Leaders: Faber Xavier and Tiago Amaral.

How to install BlipDataForge locally

Although this library runs only on databricks environment, it is possible to install it locally to create scripts with python linter help.

The easiest way to use Python packages from the command line is with pip (19.2+) and the Azure Artifacts keyring. Follow the below steps to make sure your enviroment is ready to use the blipdataforge.

  1. Download Python
  2. Update pip
python -m pip install --upgrade pip
  1. Install the keyring
pip install keyring artifacts-keyring
  1. If you're using Linux, ensure you've installed the prerequisites, which are required for artifacts-keyring.
  2. Create a virtual environment if you don't have one already.
  3. Add a pip.ini file (Windows) or pip.conf file (Mac/Linux) in your virtualenv with the following content:
[global]
index-url=https://curupira.pkgs.visualstudio.com/DataPlatform_Projects/_packaging/dataplatform_feed_prod/pypi/simple/
  1. Run this command in your project directory
pip install blipdataforge

This will install the BlipDataForge package in your local environment, and you will be ready to use it in your Python scripts.