Takespark

To enable the migration from the dslabsbricks, functions from the TakeSpark had to be incorporated into the dataforge package. Our team is working to make available all functions the users may need. Here, it is listed all functions ready for use.

Save Table (save_table)

Module: save_table

Functions:

• save_tables_alt
• initial_info

How to use:

from blipdataforge.takespark.save_table import save_tables_alt

Import Data (import_data)

The import data refers to the functions that read that from some source and save it to lake.

Module: import_data.google_spreadsheets

Functions:

• google_access_spreadsheet

• google_read_worksheet

How to use:

    from blipdataforge.takespark.import_data.google_spreadsheets import google_read_worksheet

Pipeline Utils (pipeutils)

Module: pipeutils

Functions:

• check_delta_update

How to use:

from blipdataforge.takespark.pipeutils.PipelineUtils import check_delta_update

Refining (refining)

Module: refining

The refining functions are break down in 5 groups:

#### 1. Desk

Desk contains the functions that refine desk related data

Functions:

• desk_tickets_per_hour

• desk_tickets_per_hour

• desk_attendantsstatus_base

• desk_attendantsstatus_per_window

• desk_messages_base

• desk_messages_base_alt

• desk_messag'es_analysis

You can use the following command to import a single function

from blipdataforge.takespark.refining.desk import desk_tickets_per_hour

Or this command to import all functions related to desk

from blipdataforge.takespark.refining.desk import *

2. Events_Messages

Events_Messages contains the functions that refine eventtracks and messages related data

Functions:

• events_messages_base

• events_messages_users_inputs

You can use the following command to import a single function

from blipdataforge.takespark.refining.events_messages import events_messages_base

Or this command to import all functions related to desk

from blipdataforge.takespark.refining.events_messages import *

3. Eventtracks

Eventtracks contains the functions that refine eventtracks related data

Functions:

• eventtracks_base

• eventtracks_session

• eventtracks_decomp_query

• eventtracks_decomp_tree

• eventtracks_users_last_event

• eventtracks_email_session_table

You can use the following command to import a single function

from blipdataforge.takespark.refining.eventtracks import eventtracks_base

Or this command to import all functions related to desk

from blipdataforge.takespark.refining.eventtracks import *

4. Messages

Messages contains the functions that refine messages related data

Functions:

• messages_base

• messages_base_alt

• messages_mrr

• messages_session_definer

• messages_states_decomp

• messages_session_steps

• messages_per_window

• messages_mrr_alt

You can use the following command to import a single function

from blipdataforge.takespark.refining.messages import messages_base

Or this command to import all functions related to desk

from blipdataforge.takespark.refining.messages import *

5. Support

Miscellaneous support functions

Functions:

• aux_tunnel_id

• aux_accountcontacts

• aux_irisaccounts

• aux_get_tenant_bots

• aux_get_date_br

• aux_clean_dataframe_cols

• aux_format_whatsapp_number

• aux_get_company_deals

• aux_geoloc
• aux_get_bots_deals
• aux_get_company_deals
• aux_get_tenant_bots

You can use the following command to import a single function

from blipdataforge.takespark.refining.support import aux_tunnel_id

Or this command to import all functions related to desk

from blipdataforge.takespark.refining.support import *

5. Tickets

Tickets contains the functions that refine tickets related data

Functions:

• tickets_bots_filter

You can use the following command to import a single function

from blipdataforge.takespark.refining.tickets import tickets_bots_filter

Or this command to import all functions related to tickets

from blipdataforge.takespark.refining.tickets import *

Send (send)

Module: send

Functions that send data to different targets, example buckets, sftp, etc.

1. Blob

Functions:

• write_dataframe_as_excel

• write_dataframe_as_csv

• write_dataframe_as_parquet

• write_dataframe_as_json

You can use the following command to import a single function

from blipdataforge.takespark.send.blob import write_dataframe_as_excel

Or this command to import all functions related to desk

from blipdataforge.takespark.send.blob import *

2. Bucket

Functions:

• write_to_s3_bucket

• write_to_gcp_bucket

You can use the following command to import a single function

from blipdataforge.takespark.send.bucket_write import write_to_s3_bucket

Or this command to import all functions related to desk

from blipdataforge.takespark.send.bucket_write import *

3. Email

Functions:

• send_email_general

• send_mail

• send_csv_mail

• email_files_generator

• send_mult_csv_mail

• send_text_mail

• send_xlsx_mail

You can use the following command to import a single function

from blipdataforge.takespark.send.email import send_email_general

Or this command to import all functions related to desk

from blipdataforge.takespark.send.email import *

4. SFTP

Functions:

• sftp_put_file

You can use the following command to import a single function

from blipdataforge.takespark.send.sftp import sftp_put_file

Or this command to import all functions related to desk

from blipdataforge.takespark.send.sftp import *

Widgets (widgets)

Module: widgets

Functions related to notebook widgets. Implements the following functions:

Functions:

• register_report_intent

• update_report_intent

• create_date_widgets

• get_date_widgets

• create_adf_widgets

• get_adf_widgets

• create_adf_waba_widgets

• get_adf_waba_widgets

• create_base_take_widgets

• get_base_take_widgets

You can use the following command to import a single function

from blipdataforge.takespark.widgets import register_report_intent

Or this command to import all functions related to desk

from blipdataforge.takespark.widgets import *

Small talks (smalltalks)

Module: smalltalks

Implements the following functions:

Functions:

• smalltalks_dataframe_batch