github.com/SamuelTissot/bqueue
Readme
| branch | status |
|---|---|
| master |  |
A buffered async queue
We needed a simple and quick queue system. to handle request rapidely without impacting performance. Each of our job could take up to 20s to execute.
by using the awesomeness of channels
Channels are the pipes that connect concurrent goroutines. You can send values into channels from one goroutine and receive those values into another goroutine
With channels we are able to flow the data between states without any performance impact
┌─────────────────────────────────┐ ┌───────────────────────────────┐
│Queue │ │Worker │
│--- │ │--- │
│ maxWorker int │ │ ID int │
│ JobRequests chan chan Job │ │ JobHunting chan Job │
│ JobReceived chan Job │ │ jobRequests chan chan Job │
│ │ │ QuitChan chan bool │
│ │ │ │
│M: Start() │ │ │
│- │ │ │
│Also initialize the workers │ ┌────────────────┐ │ │
│and channels │ │ share the same │ │M: Start() | goroutine │
│ │ │ instance │ │- │
│ │ ├────────────────┤ ┌──▶│Receive a job from JobRequests │
│M: CollectJob(j Job) │ │JobRequests │ │ │Calls do passing the job │
│- │┌───▶│--- │──┘ │ │
│adds the job to the JobReceived ││ │(chan chan Job) │ │ │
│ ││ └────────────────┘ │ │
│ ││ │M: do(j Job) │
│M: dispatch() | goroutine ──┼┘ │- │
│- │ │process the job │
│Looks for job in JobReceived │ │ │
│Then add it to the JobRequests │ │ │
│ │ │ │
│ │ │ │
│ │ │ │
│ │ │ │
│ │ │ │
│ │ │ │
│ │ │ │
│ │ │ │
│ │ │ │
│ │ │ │
│ │ │ │
└─────────────────────────────────┘ └───────────────────────────────┘
FAQs
Package bqueue is a "in memory" queue. it Collects jobs via the `CollectJob` func who takes a interface `Job`
Did you know?
Socket for GitHub automatically highlights issues in each pull request and monitors the health of all your open source dependencies. Discover the contents of your packages and block harmful activity before you install or update your dependencies.
Security News
Cyber extortion in the US and Canada hit record levels in 2023, with ransomware attacks surging and median ransom demands skyrocketing, though fewer companies are choosing to pay ransoms.
Security News
Ecma TC39 is meeting this week and has moved key ECMAScript proposals forward, advancing Deferred Import Evaluation, Error.isError(), RegExp Escaping, and Promise.try to the next stages.
Security News
Researchers have demonstrated that teams of LLM agents can exploit zero-day vulnerabilities with a 53% success rate, and the costs of using AI to do so are rapidly becoming more affordable than hiring a human penetration tester.