GitHub API call failed

🐞 Report an issue
1

Error message (if aplicable): API call failed. An error occourred calling out an API

{
  "clientErrorCode": "ApiHttpError",
  "userHint": "An error occurred calling out to an API.",
  "trackError": "default",
  "clientErrorHistory": [
    {
      "clientErrorCode": "ApiHttpError",
      "clientErrorDetails": {
        "url": "https://api.github.com/search/commits?q=author:tuifeisec",
        "status": 403,
        "statusText": ""
      },
      "message": "API call failed.",
      "stack": "Error: API call failed.\n    at f.from (chrome-extension://ihhkmalpkhkoedlmcnilbbhhbhnicjga/background.js:80:14741)\n    at Object.from (chrome-extension://ihhkmalpkhkoedlmcnilbbhhbhnicjga/background.js:87:4359)\n    at kE.getErrorFromResponseBody (chrome-extension://ihhkmalpkhkoedlmcnilbbhhbhnicjga/731.js:1:13000)\n    at kE.getErrorFromResponse (chrome-extension://ihhkmalpkhkoedlmcnilbbhhbhnicjga/731.js:1:12607)\n    at async Object.getUserEmails (chrome-extension://ihhkmalpkhkoedlmcnilbbhhbhnicjga/731.js:44:49856)\n    at async po.handle (chrome-extension://ihhkmalpkhkoedlmcnilbbhhbhnicjga/731.js:59:1632)\n    at async chrome-extension://ihhkmalpkhkoedlmcnilbbhhbhnicjga/731.js:550:88358\n    at async wy.invokeFunction (chrome-extension://ihhkmalpkhkoedlmcnilbbhhbhnicjga/731.js:550:88166)\n    at async wy.invokeSequence (chrome-extension://ihhkmalpkhkoedlmcnilbbhhbhnicjga/731.js:550:79537)\n    at async wy.invokePlaybook (chrome-extension://ihhkmalpkhkoedlmcnilbbhhbhnicjga/731.js:550:81036)\n    at async eg.execute (chrome-extension://ihhkmalpkhkoedlmcnilbbhhbhnicjga/731.js:550:98709)\n    at async eg.executeWithResult (chrome-extension://ihhkmalpkhkoedlmcnilbbhhbhnicjga/731.js:550:99264)",
      "userHint": "An error occurred calling out to an API.",
      "fingerprint": [
        "ApiHttpError"
      ]
    },
    {
      "clientErrorCode": "GenericObject: You have exceeded a secondary rate limit. Please wait a few minutes before you try again.",
      "clientErrorDetails": {
        "documentation_url": "https://docs.github.com/en/free-pro-team@latest/rest/overview/resources-in-the-rest-api#secondary-rate-limits"
      },
      "message": "You have exceeded a secondary rate limit. Please wait a few minutes before you try again.",
      "fingerprint": [
        "GenericObject: You have exceeded a secondary rate limit. Please wait a few minutes before you try again."
      ]
    }
  ],
  "fingerprint": [
    "ApiHttpError",
    "GenericObject: You have exceeded a secondary rate limit. Please wait a few minutes before you try again."
  ]
}

Steps to reproduce this issue:

Run the book with the the bellow parameter
Find GitHub Repos with matching name midjourney-proxy

Bardeen version: 2.26.1
Link to Playbook or Autobook (if applicable): https://www.bardeen.ai/playbook_id/3d7c938e-7b34-404b-aeb7-98d96e69d76e?source=sharing
2

Hey there,

I’m sorry to hear that you’re facing issues with the GitHub API call. It seems like there was an error calling out to the API, possibly due to a rate limit exceeded.

I’ve reported this and hope to get an answer soon.

A possibility is you’re trying to get too many items from the API. How many repos do you want to get?

4

Hi Ivan,

I hope you’re well.

Do you have an update on this fix? I’m also experiencing the same issue.

My use cases:

  1. I’d like to scrape stargazes of repos that have c.10 stargazers to 40K+
  2. I’d like to scrape repo contributors that have 100’s of contributors.

Thanks,
Luca

5

Hi Luca

This problem comes from Github’s limits to extract many items via API.

We don’t have any updates now, you can extract smaller batches of stargazers with our integration.

I’ll check with our team so we can reconsider this fix soon. (@bagrat :eye: )

Seems like you’re trying to SCRAPE data from Github instead of getting it via API, which is a different challenge, and good alternative.

To do this, you’ll need to experiment creating your own scraper, since we don’t have a Bardeen scraper for this use-case.