lento - npm Package Compare versions
Comparing version 0.3.1 to 0.3.2
| { | ||
| "name": "lento", | ||
| "version": "0.3.1", | ||
| "version": "0.3.2", | ||
| "description": "Streaming client for Presto HTTP protocol v1", | ||
@@ -17,3 +17,3 @@ "license": "MIT", | ||
| "dependencies": { | ||
| "aggregate-error": "~2.0.0", | ||
| "aggregate-error": "~2.2.0", | ||
| "backo": "~1.1.0", | ||
@@ -24,3 +24,3 @@ "debug": "~4.1.0", | ||
| "once": "~1.4.0", | ||
| "readable-stream": "~3.1.1", | ||
| "readable-stream": "~3.3.0", | ||
| "simple-concat": "~1.0.0", | ||
@@ -27,0 +27,0 @@ "sql-escape-string": "~1.1.0" |
@@ -126,7 +126,7 @@ # lento <sup id="a1">[1](#f1)</sup> | ||
| The `pageSize` specifies the maximum number of rows per page. Presto may return less per page. If Presto returns more rows than `pageSize`, the surplus is buffered and the stream will not make another HTTP request to Presto until fully drained. Note that Presto retains finished queries for 15 minutes. If `pageSize` is <= 0 the stream emits pages as returned by Presto, without slicing them up. | ||
| The `pageSize` specifies the maximum number of rows per page. Presto may return less per page. If Presto returns more rows than `pageSize`, the surplus is buffered and the stream will not make another HTTP request to Presto until fully drained. Note that if the (remainder of) rows fit in Presto's buffers, Presto will not block (until another HTTP request is made) but instead go into the `FINISHED` state after which you have 15 minutes (by default) to fetch the remaining results. If `pageSize` is <= 0 the stream emits pages as returned by Presto, without slicing them up. | ||
| The `highWaterMark` specifies how many pages to fetch preemptively. The maximum numbers of rows held in memory is approximately `(highWaterMark || 1) * pageSize`, plus any surplus from the last HTTP request. Because Presto can return thousands of rows per request, the default `highWaterMark` is 0 so that we *don't* preemptively fetch and only hold the number of rows contained in the last HTTP request. | ||
| If you care more about throughput, you can opt to increase `highWaterMark`. This can also help if you notice Presto going into `BLOCKING` state because you're not reading fast enough. Additionally you can increase `pageSize` if processing time is minimal or if you don't mind blocking the rest of your app while processing a page. | ||
| If you care more about throughput, you can opt to increase `highWaterMark`. Additionally you can increase `pageSize` if processing time is minimal or if you don't mind blocking the rest of your app while processing a page. | ||
@@ -133,0 +133,0 @@ For tuning the Presto side of things, use [`set()`](#set). |
New alerts
License Policy Violation
LicenseThis package is not allowed per your license policy. Review the package's license to ensure compliance.
Found 1 instance in 1 package
Fixed alerts
License Policy Violation
LicenseThis package is not allowed per your license policy. Review the package's license to ensure compliance.
Found 1 instance in 1 package
Improved metrics
- Total package byte prevSize
- increased by0.21%
34851
Dependency changes
+ Addedaggregate-error@2.2.0(transitive)
+ Addedreadable-stream@3.3.0(transitive)
- Removedaggregate-error@2.0.0(transitive)
- Removedreadable-stream@3.1.1(transitive)
Updatedaggregate-error@~2.2.0
Updatedreadable-stream@~3.3.0