AzureRmStorageTable | sample module to manipulate Azure Storage Table rows

 by   paulomarquesc PowerShell Version: Current License: MIT

kandi X-RAY | AzureRmStorageTable Summary

kandi X-RAY | AzureRmStorageTable Summary

AzureRmStorageTable is a PowerShell library. AzureRmStorageTable has no bugs, it has no vulnerabilities, it has a Permissive License and it has low support. You can download it from GitHub.

Repository for a sample module to manipulate Azure Storage Table rows/entities. For a complete documentation with examples, troubleshooting guide, etc. , please refer to this link.
Support
    Quality
      Security
        License
          Reuse

            kandi-support Support

              AzureRmStorageTable has a low active ecosystem.
              It has 36 star(s) with 17 fork(s). There are 6 watchers for this library.
              OutlinedDot
              It had no major release in the last 6 months.
              There are 0 open issues and 41 have been closed. On average issues are closed in 62 days. There are 1 open pull requests and 0 closed requests.
              It has a neutral sentiment in the developer community.
              The latest version of AzureRmStorageTable is current.

            kandi-Quality Quality

              AzureRmStorageTable has 0 bugs and 0 code smells.

            kandi-Security Security

              AzureRmStorageTable has no vulnerabilities reported, and its dependent libraries have no vulnerabilities reported.
              AzureRmStorageTable code analysis shows 0 unresolved vulnerabilities.
              There are 0 security hotspots that need review.

            kandi-License License

              AzureRmStorageTable is licensed under the MIT License. This license is Permissive.
              Permissive licenses have the least restrictions, and you can use them in most projects.

            kandi-Reuse Reuse

              AzureRmStorageTable releases are not available. You will need to build from source code and install.
              Installation instructions, examples and code snippets are available.

            Top functions reviewed by kandi - BETA

            kandi's functional review helps you automatically verify the functionalities of the libraries and avoid rework.
            Currently covering the most popular Java, JavaScript and Python libraries. See a Sample of AzureRmStorageTable
            Get all kandi verified functions for this library.

            AzureRmStorageTable Key Features

            No Key Features are available at this moment for AzureRmStorageTable.

            AzureRmStorageTable Examples and Code Snippets

            No Code Snippets are available at this moment for AzureRmStorageTable.

            Community Discussions

            QUESTION

            Uploading large csv to table storage with PowerShell (not sequential)
            Asked 2020-May-18 at 13:45

            I need an advice how to upload a large csv file (about one minion lines) into a Azure table storage with PowerShell. I am aware about Add-AzTableRow -table $using:table -partitionKey $partitionKey -rowKey $rowKey -property $tableProperty

            https://github.com/paulomarquesc/AzureRmStorageTable/tree/master/docs

            Based on tests with a smaller file with 10 000 lines it takes about 10 min to upload, processing sequentially. (It should be about 16-20 hours for 1 000 000 lines)

            I have tried the smaller file (10 000 lines) with PowerShell 7 to use Foreach-Object -Parallel, but the funny thing is that it takes about 3 times more. From three tests, two uploaded 10 000 lines of file for about 30 mins, one for 47 mins.

            Just for comparison, I took less than an hour to upload the one minion lines file with Storage Explorer! So I was wondering what is the process they are using and could it be used with PowerShell?

            I have reviewed the following article:

            https://blog.kloud.com.au/2019/02/05/loading-and-querying-data-in-azure-table-storage-using-powershell/

            Which should be working, but it returns an error with: $table.CloudTable.ExecuteBatch($batchOperation)

            So my question would be: Is there any way to load data into Azure table storage in parallel?

            As requested, adding the code used.

            Note: Code works just fine, but it takes time and I believe It could be faster. Looking for suggestions how to improve.

            ...

            ANSWER

            Answered 2020-May-18 at 03:39

            According to the script you provide, you use the command Get-AzStorageTable -Name $tableName -Context $saContext).CloudTable to get a CouldTable Object. Its type is Microsoft.Azure.Cosmos.Table.CloudTableClient. So if we want to execute batch operations with the client, we need to set the type of batch operations as Microsoft.Azure.Cosmos.Table.TableBatchOperation. Besides, please note that all entities in a batch must have the same PartitionKey. If your entities have different PartitionKeys, they need to be in separate batches

            For example

            Source https://stackoverflow.com/questions/61812923

            Community Discussions, Code Snippets contain sources that include Stack Exchange Network

            Vulnerabilities

            No vulnerabilities reported

            Install AzureRmStorageTable

            In a Windows Server 2016/Windows 10 execute the following cmdlets in order to install required modules.
            In a Windows Server 2016/Windows 10 execute the following cmdlets in order to install required modules Install-Module Az.Resources -AllowClobber -Force Install-Module Az.Storage -AllowClobber -Force
            Install AzureRmStorageTable Install-Module AzureRmStorageTable
            Add-AzTableRow
            Get-AzTableRow
            Get-AzTableRowAll
            Get-AzTableRowByColumnName
            Get-AzTableRowByCustomFilter
            Get-AzTableRowByPartitionKey
            Get-AzTableRowByPartitionKeyRowKey
            Get-AzTableTable
            Remove-AzTableRow
            Update-AzTableRow

            Support

            For any new features, suggestions and bugs create an issue on GitHub. If you have any questions check and ask questions on community page Stack Overflow .
            Find more information at:

            Find, review, and download reusable Libraries, Code Snippets, Cloud APIs from over 650 million Knowledge Items

            Find more libraries
            CLONE
          • HTTPS

            https://github.com/paulomarquesc/AzureRmStorageTable.git

          • CLI

            gh repo clone paulomarquesc/AzureRmStorageTable

          • sshUrl

            git@github.com:paulomarquesc/AzureRmStorageTable.git

          • Stay Updated

            Subscribe to our newsletter for trending solutions and developer bootcamps

            Agree to Sign up and Terms & Conditions

            Share this Page

            share link