Google PubSub Connector > Mappings and mapping tasks with Google PubSub Connector > Google PubSub sources in mappings
  

Google PubSub sources in mappings

To pull messages from a Google PubSub object, configure a Google PubSub object as a Source transformation in a mapping.
Specify the name and description of the Google PubSub source. Configure the source and advanced properties for the source object.
Data Integration supports topics_Get, topics_List, topics_GetIamPolicy, topics_SubscriptionsList, subscriptions_Get, subscriptions_List, subscription_GetIamPolicy, subscriptions_pull, snapshots_List, and snapshots_GetIamPolicy objects for Google PubSub sources.
The following table describes the properties that you can configure for a Google PubSub source:
Property
Description
Connection
Name of the Google PubSub source connection.
Source Type
Type of the Google PubSub source object available. You can pull messages from a single Google PubSub source object.
Note: You cannot pull messages from multiple objects or parameterize a Google PubSub source object.
Object
Name of the source object for the mapping.
You can set the tracing level in the advanced properties session to determine the amount of details that logs contain.
The following table describes the tracing levels that you can configure:
Tracing Level
Description
Terse
The Secure Agent logs initialization information, error messages, and notification of rejected data.
Normal
The Secure Agent logs initialization and status information, errors encountered, and skipped rows due to transformation row errors. Summarizes session results, but not at the level of individual rows.
Verbose Initialization
In addition to normal tracing, the Secure Agent logs additional initialization details, names of index and data files used, and detailed transformation statistics.
Verbose Data
In addition to verbose initialization tracing, the Secure Agent logs each row that passes into the mapping. Also notes where the Secure Agent truncates string data to fit the precision of a column and provides detailed transformation statistics.
When you configure the tracing level to verbose data, the Secure Agent writes row data for all rows in a block when it processes a transformation.

Data filters

Data filters help you to fetch specific data of a particular object. The mapping will process the data based on the filter field assigned to the object.
You can create simple data filters for the following objects in Google PubSub:

Filter fields

The following tables provides information on various filter fields that you must configure to pull messages from or push messages to the Google PubSub objects.
Object
Filters Fields
Datatype
Example
TopicGet
Topic
String
Topic = topicname
TopicsList
NextPageToken
String
nextPageToken = djdefkikaks
TopicsGetIamPolicy
resource
String
Resource = topicname
TopicsSubscriptionList
Topic
String
Topic = topicname
NestpageToken
String
nextPageToken = abcdefghijk
SnapshotList
NextPageToken
String
nextPageToken = djdefkikaks
SnapshotGetIamPolicy
Resource
String
Resource = snapshotName
SubscriptionGet
Subscription
String
Subscription = subscriptionName
SubscriptionGetIamPolicy
Resource
String
Resource = subscriptionName
SubscriptionList
NextPageToken
String
nextPageToken = djdefkikaks
SubscriptionPull
MaxMessages
Integer
MaxMessages = 34
ACK
Boolean
ACK = true