# Dremio Tasks


This module contains a collection of tasks for interacting with Dremio Query Engine via the pyarrow library.

# DremioFetch

class

prefect.tasks.dremio.dremio.DremioFetch

(username=None, password=None, hostname=None, flightport=32010, tls=False, certs=None, query=None, **kwargs)[source]

Task for fetching results of a query using Dremio Query Engine.

Args:

  • username (str): user name used to authenticate
  • password (str): password used to authenticate
  • hostname (str): Dremio host address
  • flightport (int, optional): port used to connect to FlightClient, defaults to 32010 if not provided
  • tls (bool): connect to the server endpoint with an encrypted TLS connection
  • certs (str): path to a certificate
  • query (str, optional): query to execute against Dremio
  • **kwargs (Any, optional): additional keyword arguments to pass to the Task constructor

methods:                                                                                                                                                       

prefect.tasks.dremio.dremio.DremioFetch.run

(username, password, hostname, flightport, tls, certs, query)[source]

Task run method. Executes a query against Dremio and fetches results.

Args:

  • username (str): user name used to authenticate
  • password (str): password used to authenticate
  • hostname (str): Dremio host address
  • flightport (int, optional): port used to connect to FlightClient, defaults to 32010 if not provided
  • tls (bool): connect to the server endpoint with an encrypted TLS connection
  • certs (str): path to a certificate
  • query (str, optional): query to execute against query engine
Returns:
  • dict: a dictionary of data returned by Dremio
Raises:
  • ValueError: if query is None



This documentation was auto-generated from commit ffa9a6c
on February 1, 2023 at 18:44 UTC