bazel-buildfarm | Bazel remote caching and execution service | Performance Testing library
kandi X-RAY | bazel-buildfarm Summary
kandi X-RAY | bazel-buildfarm Summary
This repository hosts the Bazel remote caching and execution system. Background information on the status of caching and remote execution in bazel can be found in the bazel documentation. File issues here for bugs or feature requests, and ask questions via build team slack in the #buildfarm channel.
Support
Quality
Security
License
Reuse
Top functions reviewed by kandi - BETA
- The list of available slots
- Execute a command .
- Reports an operation to the worker .
- Uploads an output directory .
- Creates a new decorator that wraps the contents of the map .
- Attempts to match the given platform .
- Searches for missing blobs on the worker thread .
- Proxy the indexes to a directory .
- Helper method to print an action result .
- Fetch all the nodes from the queue .
bazel-buildfarm Key Features
bazel-buildfarm Examples and Code Snippets
Community Discussions
Trending Discussions on bazel-buildfarm
QUESTION
I am trying to build TensorFlow using bazel-buildfarm. I have a server and a single worker setup using the example configurations available at https://github.com/bazelbuild/bazel-buildfarm (see examples/
directory). The lone worker is on a 72-core machine.
The problem I'm having is that once I kick off a build, although the build targets are being successfully dispatched to the worker, the worker is not taking advantage of all my cores (not even close). I tried explicitly setting --jobs=100
on the client when I initiate the TensorFlow build, but to no avail.
Does anyone have an idea how I can get my single worker to fully utilize the processing power available to it? Does this need to be specified explicitly in a worker configuration file?
...ANSWER
Answered 2020-Feb-27 at 20:35The worker configuration file has a setting called execute_stage_width
which can be used to specify degree of concurrency.
QUESTION
I'm trying to build TensorFlow from-source using remote execution+caching with bazel-buildfarm. I have setup a bazel-buildfarm server and worker using example configuration files @ https://github.com/bazelbuild/bazel-buildfarm (see examples/
directory).
I added the following rules to .bazelrc inside the source repo for TensorFlow (head of master):
...ANSWER
Answered 2020-Feb-26 at 20:22Remove the --spawn_strategy
and --genrule_strategy
flags. Actions will use remote execution whenever available, and fallback to local or sandboxed options otherwise. It sounds like the genrule needs to run locally, but your flags are preventing it from doing so.
Community Discussions, Code Snippets contain sources that include Stack Exchange Network
Vulnerabilities
No vulnerabilities reported
Install bazel-buildfarm
You can use bazel-buildfarm like any standard Java library. Please include the the jar files in your classpath. You can also use any IDE and you can run and debug the bazel-buildfarm component as you would do with any other Java program. Best practice is to use a build tool that supports dependency management such as Maven or Gradle. For Maven installation, please refer maven.apache.org. For Gradle installation, please refer gradle.org .
Support
Reuse Trending Solutions
Find, review, and download reusable Libraries, Code Snippets, Cloud APIs from over 650 million Knowledge Items
Find more librariesStay Updated
Subscribe to our newsletter for trending solutions and developer bootcamps
Share this Page