Troubleshooting
Known Issues
There are a few bugs in Zebra that we’re still working on fixing:
-
Progress bar estimates can become extremely large. This may be improved in recent versions of the progress bar library.
-
Zebra currently gossips and connects to private IP addresses, we want to disable private IPs but provide a config (#3117) in an upcoming release
-
Block download and verification sometimes times out during Zebra’s initial sync #5709. The full sync still finishes reasonably quickly.
-
Experimental Tor support is disabled until Zebra upgrades to the latest
arti-client. #8328
Memory Issues
- If Zebra’s build runs out of RAM, try setting
export CARGO_BUILD_JOBS=2. - If Zebra’s tests timeout or run out of RAM, try running
cargo test -- --test-threads=2. Note thatcargouses all processor cores on your machine by default.
Network Issues
Some of Zebra’s tests download Zcash blocks, so they might be unreliable
depending on your network connection. You can set SKIP_NETWORK_TESTS=1
to skip the network tests.
Issues with Tests on macOS
Some of Zebra’s tests deliberately cause errors that make Zebra panic. macOS records these panics as crash reports. If you are seeing “Crash Reporter” dialogs during Zebra tests, you can disable them using this Terminal.app command:
defaults write com.apple.CrashReporter DialogType none
Improving Performance
Zebra typically syncs in around three days on Mainnet and half a day on
Testnet under optimal conditions. The actual sync speed depends on your network
connection, hardware, and the overall Zcash network load. The major constraint we’ve found on zebrad performance is the
network weather, especially the ability to make good connections to other Zcash
network peers. If you’re having trouble syncing, try the following config
changes.
Release Build
Make sure you’re using a release build on your native architecture.
Syncer Lookahead Limit
If your connection is slow, try downloading fewer blocks at a time:
[sync]
lookahead_limit = 1000
max_concurrent_block_requests = 25
Peer Set Size
If your connection is slow, try connecting to fewer peers:
[network]
peerset_initial_target_size = 25
Turn off debug logging
Zebra logs at info level by default.
If Zebra is slow, make sure it is logging at info level:
[tracing]
filter = 'info'
Or restrict debug logging to a specific Zebra component:
[tracing]
filter = 'info,zebra_network=debug'
If you keep on seeing multiple info logs per second, please open a bug.
Linux TCP tuning for block propagation
On Linux, the kernel resets each TCP connection’s congestion window after a short idle period
(net.ipv4.tcp_slow_start_after_idle=1, the default on most distros). Zcash’s
pull-based, single-request-per-block propagation means most peer connections are
idle between blocks, so every full-block transfer starts from a cold congestion
window. On long-haul links this can cap single-peer throughput far below the
available bandwidth — even between nodes with 1–2 Gbps connections, observed
throughput during block propagation can be as low as ~6 Mbps.
Warning: these settings are system-wide. They affect every TCP connection on the host and every program using it, not just Zebra. Review the implications before applying, particularly on multi-tenant or production hosts running unrelated workloads.
The recommended sysctl config is:
# Disable slow-start-after-idle so TCP doesn't reset its congestion window
# between block requests. This is the highest-impact setting for full-block
# propagation on long-haul links.
net.ipv4.tcp_slow_start_after_idle=0
# Use CUBIC congestion control (already the default on most Linux distros;
# set explicitly so the configuration is self-documenting).
net.ipv4.tcp_congestion_control=cubic
# Use fq_codel as the default queueing discipline.
net.core.default_qdisc=fq_codel
To apply persistently, write the block above to
/etc/sysctl.d/99-zebra-network.conf and reload with
sudo sysctl --system. To apply for the current boot only, use
sudo sysctl -w <key>=<value> for each line.
Zebra logs a warning at startup on Linux if tcp_slow_start_after_idle is
enabled.
Running Zebra in Docker
These sysctls must be applied on the host, not inside the container. Containers share the host’s network stack settings for these knobs, so setting them inside the container has no effect. Apply them on the Docker host (and remember the system-wide caveat above).