# Dremio Tasks


This module contains a collection of tasks for interacting with Dremio Query Engine via the pyarrow library.

# DremioFetch

class

prefect.tasks.dremio.dremio.DremioFetch

(user, password, host, port=32010, query=None, **kwargs)[source]

Task for fetching results of a query using Dremio Query Engine.

Args:

  • user (str): user name used to authenticate
  • password (str): password used to authenticate
  • host (str): Dremio host address
  • port (int, optional): port used to connect to FlightClient, defaults to 32010 if not provided
  • query (str, optional): query to execute against Dremio
  • **kwargs (Any, optional): additional keyword arguments to pass to the Task constructor

methods:                                                                                                                                                       

prefect.tasks.dremio.dremio.DremioFetch.run

(user, password, host, port, query)[source]

Task run method. Executes a query against Dremio and fetches results.

Args:

  • user (str): user name used to authenticate
  • password (str): password used to authenticate
  • host (str): Dremio host address
  • port (int, optional): port used to connect to FlightClient, defaults to 32010 if not provided
  • query (str, optional): query to execute against query engine
Returns:
  • dict: a dictionary of data returned by Dremio
Raises:
  • ValueError: if query is None



This documentation was auto-generated from commit 1867f20
on June 2, 2021 at 18:13 UTC