gpbackup | GPDB Backup Utility | Continuous Backup library

 by   greenplum-db Go Version: 1.28.1 License: Apache-2.0

kandi X-RAY | gpbackup Summary

kandi X-RAY | gpbackup Summary

gpbackup is a Go library typically used in Backup Recovery, Continuous Backup applications. gpbackup has no bugs, it has no vulnerabilities, it has a Permissive License and it has low support. You can download it from GitHub.

GPDB Backup Utility
Support
    Quality
      Security
        License
          Reuse

            kandi-support Support

              gpbackup has a low active ecosystem.
              It has 51 star(s) with 60 fork(s). There are 21 watchers for this library.
              OutlinedDot
              It had no major release in the last 12 months.
              There are 20 open issues and 41 have been closed. On average issues are closed in 84 days. There are 2 open pull requests and 0 closed requests.
              It has a neutral sentiment in the developer community.
              The latest version of gpbackup is 1.28.1

            kandi-Quality Quality

              gpbackup has 0 bugs and 426 code smells.

            kandi-Security Security

              gpbackup has no vulnerabilities reported, and its dependent libraries have no vulnerabilities reported.
              gpbackup code analysis shows 0 unresolved vulnerabilities.
              There are 1 security hotspots that need review.

            kandi-License License

              gpbackup is licensed under the Apache-2.0 License. This license is Permissive.
              Permissive licenses have the least restrictions, and you can use them in most projects.

            kandi-Reuse Reuse

              gpbackup releases are available to install and integrate.
              Installation instructions, examples and code snippets are available.
              It has 36483 lines of code, 797 functions and 148 files.
              It has high code complexity. Code complexity directly impacts maintainability of the code.

            Top functions reviewed by kandi - BETA

            kandi has reviewed gpbackup and discovered the below as its top functions. This is intended to give you an instant insight into gpbackup implemented functionality, and help decide if they suit your requirements.
            • backupDataForAllTablesCopyQueue returns a copy of all tables for all the given tables .
            • createPrivilegeStrings returns the privilege string for the given object type .
            • GetBaseTypes returns a list of base type families .
            • GetAggregates returns a slice of Aggregate .
            • doRestoreAgent restores the agent from the agent file .
            • restoreDataFromTimestamp restore data from master data
            • backupDataForAllTables returns a list of rows copied from the given tables .
            • PrintCreateRoleStatements prints create role statements
            • DoBackup is used to perform a backup
            • ParseACL parses an ACL from a string
            Get all kandi verified functions for this library.

            gpbackup Key Features

            No Key Features are available at this moment for gpbackup.

            gpbackup Examples and Code Snippets

            Greenplum Backup,Validation and code quality,Test setup
            Godot img1Lines of Code : 7dot img1License : Permissive (Apache-2.0)
            copy iconCopy
            pushd $(find ~/workspace/gpdb -name dummy_seclabel)
                make install
                gpconfig -c shared_preload_libraries -v dummy_seclabel
                gpstop -ra
                gpconfig -s shared_preload_libraries | grep dummy_seclabel
            popd
            
              
            Troubleshooting,Dummy Security Label module is not installed or configured
            Godot img2Lines of Code : 6dot img2License : Permissive (Apache-2.0)
            copy iconCopy
            SECURITY LABEL FOR dummy ON TYPE public.testtype IS 'unclassified';
                  Expected
                      : {
                          Severity: "ERROR",
                          Code: "22023",
                          Message: "security label provider \"dummy\" is not loaded",
              
            Greenplum Backup,Validation and code quality,Test execution
            Godot img3Lines of Code : 6dot img3License : Permissive (Apache-2.0)
            copy iconCopy
            make test
            
            make unit
            
            make integration
            
            make end_to_end
            
            make lint
            
            make format
              

            Community Discussions

            QUESTION

            How can I make pprof show every single function in a call tree?
            Asked 2022-Jan-09 at 20:58

            I'm trying to get a full call tree of gpbackup from https://github.com/greenplum-db/gpbackup. I use runtime/pprof, not net/http/pprof, so as far as I know there shouldn't be any time limitations for collecting stats. I start pprof server in a very beginning of a program and stop it right before os.Exit() command. To collect stats I run gpbackup, it works as intended and I get cpu.prof output. Then I use pprof --nodecount=100000 gpb cpu.prof and generate a call tree with png command. The problem is that call tree lacks of major number of functions. For example, DoBackup() starts with logging functions, but they miss in a call tree, and there are lots of other functions that don't seem to appear either. How can I make pprof show every single call in a call tree?

            ...

            ANSWER

            Answered 2022-Jan-09 at 20:58

            By default pprof removes nodes with less than 0.5% of the CPU time and edges with less then 0.1% of the CPU time. You can ask pprof to not do this by supplying the -nodefraction=0 and -edgefraction=0 flags, this might solve your issue.

            so as far as I know there shouldn't be any time limitations for collecting stats

            Not fully true, runtime/pprof samples 100 times per second. Every time it samples, it captures the full stack-trace. So you might miss functions if they execute faster than 100th of a second and are not part of the stack frame of longer running functions.

            You could copy StartCPUProfile and change the hz variable so it captures more often.

            Source https://stackoverflow.com/questions/70644428

            QUESTION

            How to sync data between two Greeplum Clusters in remote data centers (DR)
            Asked 2021-Nov-01 at 16:33

            My team is planning for a DR solution and we need to sync data between Greenplum Databases in Production and DR sites.

            We are running the 6.4 community edition. So tools like gpbackup and gprestore are not available. pg_dump and pg_restore not an option because there is large data set involved. What is most suitable solution for our scenario?

            ...

            ANSWER

            Answered 2021-Oct-28 at 17:01

            gpbackup and gprestore is one way Greenplum users commonly keep two clusters in sync.

            While gpbackup and gprestore doesn't ship with open source Greenplum Database, the tools are open source themselves and freely available from their own repository: https://github.com/greenplum-db/gpbackup

            Due to Greenplum's distribution of data across segments, there is a requirement the DR cluster contain the same # of primary segments for a successful restore (although the # of segment hosts could differ).

            A common approach we see Greenplum users implementing is backing up off cluster to a third party storage system (NFS, s3 compatible storage, etc..) and restoring to the destination/DR cluster from there.

            There is an open source gpbackup_s3_plugin available here: https://github.com/greenplum-db/gpbackup-s3-plugin

            Let us know if you have any other questions.

            oak

            Source https://stackoverflow.com/questions/69753199

            QUESTION

            Incremental backup of greenplum database not working
            Asked 2020-Feb-10 at 16:10

            In greenplum database while using gpbackup utility, I understand the heap tables, even when partitioned take full backup of the table even when we take incremental backup. But if I create the primary key or index on the heap table, shouldn't it start behaving as an append organized table? But it still takes full backup when --incremental is specified. Any reason for that?

            ...

            ANSWER

            Answered 2020-Feb-10 at 14:58

            gpcrondump utility only compares the state of each table in the database against the last backup using state files. If there is any change in the state of the table since the last backup, it is marked dirty and is backed up during an incremental backup.

            At the file level, heap tables, when vacuumed, have empty tuple slots that are filled by the next available tuple -- as soon as that slot is filled, that whole file has been modified.

            As such, gpcrondump can only take incremental backups of "append-only" tables.

            I would take a look at gpbackup - which has incremental backups on the roadmap and currently is operating much faster than gpcrondump for most backup operations.

            Source https://stackoverflow.com/questions/60151736

            QUESTION

            Greenplum Incremental backup through gpbackup takes cummulative backup
            Asked 2020-Feb-07 at 18:18

            I am using greenplum DB's gpbackup utility to take incremental backup of database, through following commands

            1: Full backup

            ...

            ANSWER

            Answered 2020-Feb-07 at 18:18

            You can find more details here, regarding the implementation of Greenplum's Incremental Backup

            https://gpdb.docs.pivotal.io/backup-restore/1-16/admin_guide/managing/backup-gpbackup-incremental.html

            In short, incremental backups work best on AO partitioned tables. gpbackup will identify which partitions of AO tables have data changes since the last full or incremental backup, and add those to the backup set.

            Heap tables are always fully backed up, regardless of the incremental flag is used.

            In your use case, were you using AO partitioned tables?

            Source https://stackoverflow.com/questions/60113370

            Community Discussions, Code Snippets contain sources that include Stack Exchange Network

            Vulnerabilities

            No vulnerabilities reported

            Install gpbackup

            Required for Greenplum Database 6 or higher, several tests require the dummy_seclabel Greenplum contrib module. This module exists only to support regression testing of the SECURITY LABEL statement. It is not intended to be used in production. Use the following commands to install the module.

            Support

            For any new features, suggestions and bugs create an issue on GitHub. If you have any questions check and ask questions on community page Stack Overflow .
            Find more information at:

            Find, review, and download reusable Libraries, Code Snippets, Cloud APIs from over 650 million Knowledge Items

            Find more libraries
            CLONE
          • HTTPS

            https://github.com/greenplum-db/gpbackup.git

          • CLI

            gh repo clone greenplum-db/gpbackup

          • sshUrl

            git@github.com:greenplum-db/gpbackup.git

          • Stay Updated

            Subscribe to our newsletter for trending solutions and developer bootcamps

            Agree to Sign up and Terms & Conditions

            Share this Page

            share link

            Explore Related Topics

            Consider Popular Continuous Backup Libraries

            restic

            by restic

            borg

            by borgbackup

            duplicati

            by duplicati

            manifest

            by phar-io

            velero

            by vmware-tanzu

            Try Top Libraries by greenplum-db

            gpdb

            by greenplum-dbC

            gporca

            by greenplum-dbC++

            PivotalR

            by greenplum-dbR

            pxf

            by greenplum-dbJava

            diskquota

            by greenplum-dbC