Custom Google Pub/Sub Logs
Collect Logs from Google Pub/Sub topics
What is an Elastic integration?
This integration is powered by Elastic Agent. Elastic Agent is a single, unified way to add monitoring for logs, metrics, and other types of data to a host. It can also protect hosts from security threats, query data from operating systems, forward data from remote services or hardware, and more. Refer to our documentation for a detailed comparison between Beats and Elastic Agent.
Prefer to use Beats for this use case? See Filebeat modules for logs or Metricbeat modules for metrics.
See the integrations quick start guides to get started:
The custom Google Pub/Sub input integration is used to ingest data from a Google Pub/Sub topic subscription that is not covered by our GCP Integration.
This integration could for example be used to receive Stackdriver logs that have been exported to a Google Pub/Sub topic.
Multiple Elastic Agent instances can be configured to read from the same subscription to achieve high-availability or increased throughput.
Configuring
-
Create a user-managed service account (you can skip this if Elastic Agent is running in a VM with a service account attached). See: Service Accounts
-
Create a Pub/Sub topic and subscription. See:Topics and Subscriptions
-
Configure this integration to read from the Pub/Sub subscription using the service account credentials.
-
Write logs into the Pub/Sub topic yourself or configure a log sink to export GCP logs to the topic. See: Managing Sinks
Changelog
| Version | Details |
|---|---|
1.11.0 | Enhancement View pull request ECS version updated to 8.10.0. |
1.10.0 | Enhancement View pull request The format_version in the package manifest changed from 2.11.0 to 3.0.0. Removed dotted YAML keys from package manifest. Added 'owner.type: elastic' to package manifest. |
1.9.0 | Enhancement View pull request Add tags.yml file so that integration's dashboards and saved searches are tagged with "Security Solution" and displayed in the Security Solution UI. |
1.8.0 | Enhancement View pull request Update package to ECS 8.9.0. |
1.7.0 | Enhancement View pull request Update package to ECS 8.8.0. |
1.6.0 | Enhancement View pull request Update package-spec version to 2.7.0. |
1.5.0 | Enhancement View pull request Update package to ECS 8.7.0. |
1.4.1 | Enhancement View pull request Added categories and/or subcategories. |
1.4.0 | Enhancement View pull request Update package to ECS 8.6.0. |
1.3.0 | Enhancement View pull request Update package to ECS 8.5.0. |
1.2.0 | Enhancement View pull request Update package to ECS 8.4.0 |
1.1.0 | Enhancement View pull request Update package to ECS 8.3.0. |
1.0.1 | Enhancement View pull request update readme |
1.0.0 | Enhancement View pull request Initial Release |