KNIME Documentation

Supported platforms ​

A platform is either a model provider, such as OpenAI or Anthropic, or a service that hosts models from several providers, such as Amazon Bedrock or Hugging Face Hub.

GenAI Gateway supports the following platforms. Each platform requires its own configuration fields, such as an API key, model name, or custom base URL. Configure these fields when you create a model.

OpenAI ​

OpenAI is an AI research and deployment company most widely known for their ChatGPT chatbot. They also offer an API that provides access to their LLMs and embedding models.

  • Supports both chat and embedding models.
  • It requires the following parameters to be configured:
    • API Key: a valid OpenAI API key.
    • Model: choose from the default models or use the model name (for example gpt-4.1, gpt-4o-mini, or text-embedding-3-small).

Azure OpenAI ​

Azure OpenAI provides access to OpenAI's GenAI models with the security and enterprise promise of Azure. It allows to manage details of deployed Azure OpenAI Resources and endpoints. This includes which region of the world the workloads are computed in and which models are deployed. For more details on the different configuration options please refer to the official documentation.

  • Supports both chat and embedding models via Azure deployments.
  • It requires the following parameters to be configured:
    • Model: The Azure deployment name (for example knime-o4-mini). This is used as the Model value.
    • API Key: One of the API keys of the deployment.
    • API Base URL: The endpoint URL of the deployment. Should point to the Azure OpenAI resource endpoint.
    • API Version: The API version of the deployment. Default API version is 2024-12-01-preview.

Amazon Bedrock ​

Amazon Bedrock is a service managed by AWS that provides access to a variety of GenAI models from different AI companies (for example Anthropic Claude or Amazon Titan).

  • Supports both chat and embedding models.
  • It requires the following parameters to be configured:
    • Model: The Bedrock model name such as anthropic.claude-3-5-sonnet-20240620-v1:0 or amazon.titan-embed-text-v2:0.
    • AWS Access Key ID: The ID of the AWS access key to use for authentication.
    • AWS Secret Access Key: The AWS secret key to use.
    • AWS Region: The AWS region (for example eu-central-1) in which to operate the resources.

Google AI Studio ​

Provides access to Gemini chat and embedding models via the Google AI Studio API.

  • Supports both chat and embedding models.
  • It requires the following parameters to be configured:
    • Model: Choose from the default models or use the model name (for example gemini-2.5-flash or text-embedding-004).
    • API Key: A valid Google AI Studio API key.

Anthropic ​

Anthropic is an AI company most well-known for their Claude models.

  • Supports only chat models.
  • It requires the following parameters to be configured:
    • Model: Choose from the default models or use the model name (for example, claude-3-5-sonnet-20240620).
    • API Key: A valid Anthropic API key.

OpenAI API-compatible providers ​

Targets any endpoint that exposes an OpenAI‑compatible API (for example vLLM, LiteLLM, or other custom servers). Useful when you self‑host or proxy models but still want to reuse the OpenAI request format.

OpenAI's API is also used by a variety of other providers and by a number of inference solution that allow hosting your own model.

It requires the following parameters to be configured:

  • Model: The name of the model.
  • API Key: A valid API key for the provider if it requires one. For some providers that do not require authentication a placeholder value can be used.
  • API Base URL: The base URL of the OpenAI-compatible API. This is required.

Hugging Face Hub ​

Hugging Face Hub is the platform for accessing open source GenAI models. It offers two different ways to access models:

Inference Providers ​

Via its Inference Providers API it provides access to a variety of LLMs and embedding models hosted by Hugging Face.

  • Supports only chat models. See the documentation for details.
  • It requires the following parameters to be configured:
    • Model: The repository of the model (for example meta-llama/Llama-3.2-3B-Instruct).
    • API Key: A valid Hugging Face API key.
    • API Base URL: The base URL of the Inference Providers API (defaults to https://router.huggingface.co/v1).

Dedicated Inference Endpoints ​

Hugging Face Hub also supports Dedicated Inference Endpoints as an easy way to quickly deploy a variety of LLMs and embedding models to the cloud of your choice.

  • Supports both chat and embedding models.
  • It requires the following parameters to be configured:
    • Model: The repository of the model prefixed with huggingface/.
    • API Key: A valid Hugging Face API key.
    • API Base URL: The URL of the deployed endpoint.

Mistral AI ​

Mistral AI is an AI company that provides access to their LLMs via an API.

  • Supports both chat and embedding models.
  • It requires the following parameters to be configured:
    • Model: The name of the Mistral model (for example mistral-large-2512).
    • API Key: A valid Mistral AI API key.
    • API Base URL: Custom API base URL (defaults to the standard Mistral endpoint).

Ollama ​

Ollama is a local-first inference platform that allows running LLMs.

  • Supports both chat and embedding models.
  • It requires the following parameters to be configured:
    • Model: The name of the Ollama model (for example llama2:13b).
    • API Key: Not required for local deployments. To access remote Ollama Cloud models, a valid Ollama API key is needed.
    • API Base URL: The base URL of the Ollama API (defaults to Ollama Cloud https://ollama.com).