Skip to content

ChatHuggingface is reaching out to huggingface when using local HuggingFaceEndpoint #30333

@JoeSF49

Description

@JoeSF49

Checked other resources

  • I added a very descriptive title to this issue.
  • I searched the LangChain documentation with the integrated search.
  • I used the GitHub search to find a similar question and didn't find it.
  • I am sure that this is a bug in LangChain rather than my code.
  • The bug is not resolved by updating to the latest stable version of LangChain (or the specific integration package).

Example Code

Setting ChatHuggingFace llm param to locally hosted HuggingFaceEndpoint is trying to reach out to hugginface website and failing on air-gapped system.

i recieve 401s and 404s due to api trying to reach and login to hugginface instead of using HuggingFaceEndpoint. When i invoke HuggingFaceEndpoint directly I receive response needed. I'm trying to load it into ChatHuggingFace so that I may hopefully use "with_structured_output"

Error Message and Stack Trace (if applicable)

system is air-gapped and i cannot transfer from it. i recieve 401s and 404s due to api trying to reach and login to hugginface instead of using HuggingFaceEndpoint.

Description

i recieve 401s and 404s due to api trying to reach and login to hugginface instead of using HuggingFaceEndpoint. When i invoke HuggingFaceEndpoint directly I receive response needed. I'm trying to load it into ChatHuggingFace so that I may hopefully use "with_structured_output"

System Info

airgapped but rebuilt using 0.3.45

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugRelated to a bug, vulnerability, unexpected error with an existing featureexternalhelp wantedOpen to community contribution.huggingface`langchain-huggingface` package issues & PRsintegrationPR made that is related to a provider partner package integration

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions