crmint | Reliable data integration & processing for advertisers | GCP library
kandi X-RAY | crmint Summary
kandi X-RAY | crmint Summary
You can have data without information, but you cannot have information without data. — Daniel Keys Moran. CRMint was created to make advertisers' data integration and processing easy, even for people without software engineering background. CRMint has simple and intuitive web UI that allows users to create, edit, run, and schedule data pipelines consisting of data transfer and data processing jobs. This README is for building and extending CRMint as a developer. For guidance on using CRMint, refer to the User documentation. CRMint is a Google App Engine application written in Python for Google App Engine Python Standard Environment. CRMint uses Cloud SQL to store it's business data, and Stackdriver Logging to store it's activity logs. Deploy CRMint to your Google Cloud project, build a data pipeline, and benefit from data integration and processing in Google Cloud.
Support
Quality
Security
License
Reuse
Top functions reviewed by kandi - BETA
- Deploy the frontend stage
- Inject VPC connector configuration
- Set attributes from kwargs
- Persist the model
- Create a VPC
- Check if the VPC exists
- Check if VPC peering exists
- Deploy a given stage
- Get a stage context
- Run the given audiences
- Get information about a pipeline
- Check if a given stage exists
- Runs audience operations in GA4
- Creates the subscriptions for the given stage
- Execute the BQA model
- Logs a message to the logger
- Grant all required permissions for a stage
- Setup crmint
- Setup local env
- Start the crmint task
- Execute BigQuery
- Default stage context
- Deletes the oldest uploads for a given DataImport reference
- Executes the API
- Deploy the controller
- Create CloudSQL instance
crmint Key Features
crmint Examples and Code Snippets
Community Discussions
Trending Discussions on crmint
QUESTION
I am using the GAAudiencesUpdater to update audiences. The GAAudiencesUpdater seems to handle the creation of the audiences the first time fine, however, when the pipeline runs on subsequent days and uses the patch method the job fails every time. I am well within the Google Analytics API quota limits which is 50 writes per day for these types of jobs so I'm unclear as to why there is a rate limit for writes exceeded error.
The error I'm getting is: Unexpected error: HttpError: https://www.googleapis.com/analytics/v3/management/accounts/xxx/webproperties/UA-xxx-17/remarketingAudiences/xxx?alt=json returned "Quota Error: Rate limit for writes exceeded.">
Screenshot from the CRMint UI attached.
Would appreciate any guidance on why this may be the case with the patch method specifically? Thanks!
...ANSWER
Answered 2020-Nov-12 at 16:17There was a bug in the CRMint retry logic. Fortunately one of the contributors to the CRMint project resolved that bug and this isn't a concern any longer when updating audiences in CRMint.
QUESTION
I am novice to Google Analytics and I am using a tool called CRMint to import a custom audience to Google Analytics. A Data Scientist is using a model to predict if a user has more chances to buy a product than another. Right now, I have a csv
file containing 2 columns fullVisitorId
and predictions
.
On CRMint, I am using a job called "GaDataImporter
" to import that CSV file into Google Analytics. As you can see on the picture bellow, I need to provide a GA Dataset ID
.
I am currently trying to create a new DataSet from my Google Analytics dashboard but I am not sure about the dataset type
and the import bahavihor
. Anyone has some suggestions?
ANSWER
Answered 2020-Nov-10 at 20:47fullVisitorId
is not an available dimension in Google Analytics (found only on BigQuery) so you cannot use it to link information to users in Google Analytics.
Rather you should use the clientId
passed to Analytics as custom dimension, then use that as a key by importing the data as Custom Data.
(If you are novice to Google Analytics it is not something that can be explained in a post, anyway the process described is what you need)
QUESTION
A SQL-related error occurs during the deployment phase of CRMint following carefully the quick start guide. I previously had 2 SQL-related errors but I was able to fix the first one (maybe they are related). The frirst one was:
...ANSWER
Answered 2020-Oct-29 at 02:16There's an open issue link similar to your problem. A workaround is to deploy using dev branch. I tried deploying on my end and currently it worked for me as well. Just be sure to delete the master branch on your machine and use the dev CLI.
Deploy CRMint on Google Cloud Platform from the dev branch:
Community Discussions, Code Snippets contain sources that include Stack Exchange Network
Vulnerabilities
No vulnerabilities reported
Install crmint
You can use crmint like any standard Python library. You will need to make sure that you have a development environment consisting of a Python distribution including header files, a compiler, pip, and git installed. Make sure that your pip, setuptools, and wheel are up to date. When using pip it is generally recommended to install packages in a virtual environment to avoid changes to the system.
Support
Reuse Trending Solutions
Find, review, and download reusable Libraries, Code Snippets, Cloud APIs from over 650 million Knowledge Items
Find more librariesStay Updated
Subscribe to our newsletter for trending solutions and developer bootcamps
Share this Page