Transactions | Castle Transactions Service and Facility

The "transaction underpriced" error occurs, when you're trying to replace a transaction and the replacing gas price is too low.

web3.eth.getTransactionCount() only returns the amount of mined transactions. But you can have N (not just one) of transactions that are waiting to be mined with already higher nonce.

Example:

• You have submitted 4 transactions - nonces 1, 2, 3, and 4.
• Transactions 1 and 2 are successfully mined.
• getTransactionCount() returns 2
• When you're trying to submit another tx with nonce 3 or 4, it's trying to replace the already existing transactions.

Solution:

Use even higher gas price if you want to replace the existing transaction.

Or if you want to submit a new transaction (and not replace the previous), use higher nonce (sum of "successfully mined" + "waiting to be mined" + 1) that your address haven't used.

Went with option 2. The Redshift Copy/Load process writes csv with manifest to S3 in any case so duplicating that is pointless.

Regarding the Questions:

1. N/A

2. Job Bookmarking does work. There is some gotchas though - ensure Connections both to RDS and Redshift are present in Glue Pyspark job, IAM self ref rules are in place and to identify a row that is unique [I chose the primary key of underlying table as an additional column in my materialized view] to use as the bookmark.

3. Using the primary key of core table may buy efficiencies in pruning materialized views during maintenance cycles. Just retrieve latest bookmark from cli using aws glue get-job-bookmark --job-name yourjobname and then just that in the where clause of the mv as where id >= idinbookmark

   conn = glueContext.extract_jdbc_conf("yourGlueCatalogdBConnection") connection_options_source = { "url": conn['url'] + "/yourdB", "dbtable": "table in dB", "user": conn['user'], "password": conn['password'], "jobBookmarkKeys":["unique identifier from source table"], "jobBookmarkKeysSortOrder":"asc"}

datasource0 = glueContext.create_dynamic_frame.from_options(connection_type="postgresql", connection_options=connection_options_source, transformation_ctx="datasource0")

That's all, folks

item here is a Map.

Looks the question was solved by @Larnu's comment, just add it as an answer to close the question.

If you are using Azure SQL Database, then what the error is telling you is true. Azure SQL Databases are what are known as Partially Contained databases; things like their USER objects have their own Password and the LOGIN objects on the server aren't used for connections. The CONNECTION permission is a server level permission, and thus not supported in Azure SQL Databases.

Instead of filtering orders, you wanted to filter transactions. You can do that like this:

Its apparent no system is ever 100% stateless. There is always some sort of state memory however how minimal. Now the real deal should be how much state data you need to optimize your system.

https://docs.microsoft.com/en-us/azure/service-fabric/service-fabric-reliable-services-introduction

Bug fixed in beta08

References

https://issuetracker.google.com/issues/188855913

https://issuetracker.google.com/issues/188566058

Screenshot below refers:

Google sheets here

IMPORTANT UPDATE: re: 2000+ rows, see link in my last comment (for OneDrive template, s.t. expiry, and bottom of this proposal for screenshot of error "too large to import")

fyi: (Office 365 - Excel - fns. such as 'filter' etc., so #Name! will be ubiquitous upon opening this link; however, sharing this should serve as a convenient means to replicate above screenshot in the correct version of Excel)

1. Office 365
2. Adequate space to the right or ability to utilise extra sheet for calcs as req.

High-level | Take-aways

• Relies on 2 additional tables: Qty 'depletion' table (here - G:P) and corresp. Profit Vectors (here - R:Z)

• Compressed representations (2x2 tables, per Summary Tables, here: rows 19:32) could be explored to simplify matters (albeit these are still Work in Progress ['WiP'])

• VB could be attractive alternative too

Low-level | Procedural

1. Single-cell function could not be found without exceptional complication (however, suspect it could be possible e.g. using FilterXML?)
2. Qty label transposes filtered negative quantities (grey shaded, G3: J3)
3. These values are depleted in turn (from left to right, i.e. dependency on having data sorted in ascending order by date (in this depiction, data first sorted by 'fruit' as these are assumed to be independent in the context of the profit calc.)
4. For example, -5 quantity (G3) offset by +10 (B3) to yield +5 which, in turn contributes towards the -35 qty (H3) to yield -30. No further contribution can be made (left to right); next row (5): +20 avail (given), no offset against -5 (G3, already 'reimbursed', so 20 offset against -30 (H4) to yield -10, and so forth.
5. Worksheet set up to accommodate longer list of fruit / profits
6. Result table of residual 'quantities' (~ G:J) applied to price differential to yield 'profit vectors' (R:U) which are summed against corresponding negative quantities to produce Profit score (yellow shaded cells)

Salient functions (all of which should be available within Google Sheet, but for completeness):

1) Profit calc. (E4, drag down):

You can try replace your 2 lines with .count() to .sum(), as follows: