Filebeat configuration advise

Graylog Central (peer support)
1

Kindly i need your urgent advise to configure filebeat to process below log:

2019-07-02 16:00:00.037 [SUBSCRIBER_PROFILE-1157917705-d73442b7-8d07-4aee-a850-09aa51ff37e2] ********************Inquiry Item [com.etisalat.oms.inquiry.actions.Voi
ceMinutesCrossNetInquiry] Executed successfully**************************
2019-07-02 16:00:00.037 [SUBSCRIBER_PROFILE-1157917705-d73442b7-8d07-4aee-a850-09aa51ff37e2] Service Class [com.etisalat.oms.inquiry.actions.GeneralUnitsInquiry] l
oaded Successfully.
2019-07-02 16:00:00.037 [SUBSCRIBER_PROFILE-1157917705-d73442b7-8d07-4aee-a850-09aa51ff37e2] *************************** Starting Inquiry Item [com.etisalat.oms.in
quiry.actions.GeneralUnitsInquiry] *****************
2019-07-02 16:00:00.037 [SUBSCRIBER_PROFILE-1157917705-d73442b7-8d07-4aee-a850-09aa51ff37e2] Starting GeneralUnitsInquiry.execute ...
2019-07-02 16:00:00.037 [SUBSCRIBER_PROFILE-1157917705-d73442b7-8d07-4aee-a850-09aa51ff37e2] attributeType[UC], attributeValue[713], attributeMinValue[0], attribut
eMaxValue[null], attributeSubValue[71301]
2019-07-02 16:00:00.037 [SUBSCRIBER_PROFILE-1157917705-d73442b7-8d07-4aee-a850-09aa51ff37e2] ********************Inquiry Item [com.etisalat.oms.inquiry.actions.Gen
eralUnitsInquiry] Executed successfully**************************
2019-07-02 16:00:00.400 [ELIGIBLE_PRODUCT-1122220199-4b666699-b9b0-4549-8aff-537b199e040d] No product found for the RTIM offer name null
2019-07-02 16:00:00.400 [ELIGIBLE_PRODUCT-1122220199-4b666699-b9b0-4549-8aff-537b199e040d] Error While Processing Request [<?xml version="1.0" encoding="UTF-8"?>
<eligibleProductsRequest>
    <channel>myEtisalatApp</channel>
    <extraRequestParameters>
        <name>INTERACTION_POINT</name>
        <value>meaHomePage</value>
    </extraRequestParameters>
    <extraRequestParameters>
        <name>APP_LANGUAGE</name>
        <value>EN</value>
    </extraRequestParameters>
    <extraRequestParameters>
        <name>APP_VERSION</name>
        <value>9</value>
    </extraRequestParameters>
    <requestType>BEST_OFFER</requestType>
    <transactionId>860acdaa2fc04ca88c7016d4f56b083d</transactionId>
    <msisdn>1122220199</msisdn>
</eligibleProductsRequest>
].
 com.etisalat.oms.exception.ApplicationException: No eligible product  configured for this dial [1122220199]
        at com.etisalat.oms.inquiry.manager.GenericProductEligibility.postValidate(GenericProductEligibility.java:72) ~[oms.jar:?]
        at com.etisalat.oms.inquiry.manager.GenericProductEligibility.getEligibleProduct(GenericProductEligibility.java:42) ~[oms.jar:?]
        at com.etisalat.oms.interfaces.service.ProductManagementService.getEligibleProducts(ProductManagementService.java:179) ~[oms.jar:?]
        at com.etisalat.oms.interfaces.product.EligibleProductsHandler.handle(EligibleProductsHandler.java:47) [oms.jar:?]
        at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1115) [jetty-all-9.3.1.v20150714-uber.jar:9.3.1.v20150714]
        at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1051) [jetty-all-9.3.1.v20150714-uber.jar:9.3.1.v20150714]
        at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) [jetty-all-9.3.1.v20150714-uber.jar:9.3.1.v20150714]
        at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:213) [jetty-all-9.3.1.v20150714-uber.jar:9.3.1.v20150714]
        at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:119) [jetty-all-9.3.1.v20150714-uber.jar:9.3.1.v20150714]
        at org.eclipse.jetty.server.Server.handle(Server.java:517) [jetty-all-9.3.1.v20150714-uber.jar:9.3.1.v20150714]
        at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:302) [jetty-all-9.3.1.v20150714-uber.jar:9.3.1.v20150714]
        at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:242) [jetty-all-9.3.1.v20150714-uber.jar:9.3.1.v20150714]
        at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:238) [jetty-all-9.3.1.v20150714-uber.jar:9.3.1.v20150714]
        at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:95) [jetty-all-9.3.1.v20150714-uber.jar:9.3.1.v20150714]
        at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:57) [jetty-all-9.3.1.v20150714-uber.jar:9.3.1.v20150714]
        at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceAndRun(ExecuteProduceConsume.java:213) [jetty-all-9.3.1.v20150714-uber.jar:9.3.1.v20150714]
        at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:147) [jetty-all-9.3.1.v20150714-uber.jar:9.3.1.v20150714]
        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:654) [jetty-all-9.3.1.v20150714-uber.jar:9.3.1.v20150714]
        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:572) [jetty-all-9.3.1.v20150714-uber.jar:9.3.1.v20150714]
        at java.lang.Thread.run(Thread.java:745) [?:1.8.0_65]
2019-07-02 16:00:00.590 [ELIGIBLE_PRODUCT-1114444883-3431ad12-2aa2-45b2-a436-dcd7eb11585e] Loading IN Profile for dial [1114444883]
2019-07-02 16:00:00.590 [ELIGIBLE_PRODUCT-1114444883-3431ad12-2aa2-45b2-a436-dcd7eb11585e] Success Load IN profile WS
2019-07-02 16:00:00.590 [ELIGIBLE_PRODUCT-1114444883-3431ad12-2aa2-45b2-a436-dcd7eb11585e] AIRServiceWrapper.getAccountByMSISDN()
2019-07-02 16:00:00.590 [ELIGIBLE_PRODUCT-1114444883-3431ad12-2aa2-45b2-a436-dcd7eb11585e] Getting Air Subscriber Web Service Client
2019-07-02 16:00:00.595 [SUBSCRIBER_PROFILE-1152865416-aafe3234-b30d-4893-bbe5-6055adaa6630] TransactionID: ddc5b0785346406b9e4366f2b07296f7
2019-07-02 16:00:00.595 [SUBSCRIBER_PROFILE-1152865416-aafe3234-b30d-4893-bbe5-6055adaa6630] AIRServiceWrapper.getUsageThresholdsAndCountersRequestByMSISDN(1152865
416)
2019-07-02 16:00:00.595 [SUBSCRIBER_PROFILE-1152865416-aafe3234-b30d-4893-bbe5-6055adaa6630] Getting Air Subscriber Web Service Client
2019-07-02 16:00:00.633 [SUBSCRIBER_PROFILE-1152272177-4fb38876-4d08-4108-8b92-95f508c08d7d] TransactionID: 49b60bac93e64c878528ab79dfeaf61e
2019-07-02 16:00:00.633 [SUBSCRIBER_PROFILE-1152272177-4fb38876-4d08-4108-8b92-95f508c08d7d] Success get account
2019-07-02 16:00:00.633 [SUBSCRIBER_PROFILE-1152272177-4fb38876-4d08-4108-8b92-95f508c08d7d] Start getMatchedProfile
2019-07-02 16:00:00.635 [SUBSCRIBER_PROFILE-1152272177-4fb38876-4d08-4108-8b92-95f508c08d7d] serviceOfferingBit = 537133120
2019-07-02 16:00:00.635 [SUBSCRIBER_PROFILE-1152272177-4fb38876-4d08-4108-8b92-95f508c08d7d] Mask: 1082130432 Value: 8388608
2019-07-02 16:00:00.635 [SUBSCRIBER_PROFILE-1152272177-4fb38876-4d08-4108-8b92-95f508c08d7d] Result = 0
2019-07-02 16:00:00.639 [SUBSCRIBER_PROFILE-1152272177-4fb38876-4d08-4108-8b92-95f508c08d7d] Success getMatchedProfile
2019-07-02 16:00:00.640 [SUBSCRIBER_PROFILE-1152272177-4fb38876-4d08-4108-8b92-95f508c08d7d] Service Class [com.etisalat.oms.inquiry.actions.VoiceSMSInquiry] loade
d Successfully.
2019-07-02 16:00:00.640 [SUBSCRIBER_PROFILE-1152272177-4fb38876-4d08-4108-8b92-95f508c08d7d] *************************** Starting Inquiry Item [com.etisalat.oms.in
quiry.actions.VoiceSMSInquiry] *****************
2019-07-02 16:00:00.640 [SUBSCRIBER_PROFILE-1152272177-4fb38876-4d08-4108-8b92-95f508c08d7d] Starting VoiceSMSInquiry.execute ...
2019-07-02 16:00:00.640 [SUBSCRIBER_PROFILE-1152272177-4fb38876-4d08-4108-8b92-95f508c08d7d] attributeType[null], attributeValue[null], maxValue[null], attributeMi
nValue[null], attributeSubValue[null]
2019-07-02 16:00:00.640 [SUBSCRIBER_PROFILE-1152272177-4fb38876-4d08-4108-8b92-95f508c08d7d] attributeType[UC], attributeValue[910], maxValue[null], attributeMinVa
lue[0], attributeSubValue[91001]
2019-07-02 16:00:00.640 [SUBSCRIBER_PROFILE-1152272177-4fb38876-4d08-4108-8b92-95f508c08d7d] ********************Inquiry Item [com.etisalat.oms.inquiry.actions.Voi
ceSMSInquiry] Executed successfully**************************
2019-07-02 16:00:00.640 [SUBSCRIBER_PROFILE-1152272177-4fb38876-4d08-4108-8b92-95f508c08d7d] Service Class [com.etisalat.oms.inquiry.actions.NewSallefnyInquiry] lo
aded Successfully.
2019-07-02 16:00:00.640 [SUBSCRIBER_PROFILE-1152272177-4fb38876-4d08-4108-8b92-95f508c08d7d] *************************** Starting Inquiry Item [com.etisalat.oms.in
quiry.actions.NewSallefnyInquiry] *****************
2019-07-02 16:00:00.640 [SUBSCRIBER_PROFILE-1152272177-4fb38876-4d08-4108-8b92-95f508c08d7d] ********************Inquiry Item [com.etisalat.oms.inquiry.actions.New
SallefnyInquiry] Executed successfully**************************
2019-07-02 16:00:00.640 [SUBSCRIBER_PROFILE-1152272177-4fb38876-4d08-4108-8b92-95f508c08d7d] Service Class [com.etisalat.oms.inquiry.actions.DataQuotaInquiry] load
ed Successfully.
2019-07-02 16:00:00.640 [SUBSCRIBER_PROFILE-1152272177-4fb38876-4d08-4108-8b92-95f508c08d7d] *************************** Starting Inquiry Item [com.etisalat.oms.in
quiry.actions.DataQuotaInquiry] *****************
2019-07-02 16:00:00.640 [SUBSCRIBER_PROFILE-1152272177-4fb38876-4d08-4108-8b92-95f508c08d7d] Starting DataQuotaInquiry.execute ...
2019-07-02 16:00:00.640 [SUBSCRIBER_PROFILE-1152272177-4fb38876-4d08-4108-8b92-95f508c08d7d] inquiryAttributesMap[{ATTRIBUTE1:DATA_QUOTA_TYPE_ATTRIBUTE=DA, ATTRIBU
TE1:DATA_QUOTA_IS_COUNTER_REVERSED_ATTRIBUTE=true, ATTRIBUTE1:DATA_QUOTA_VALUE_ATTRIBUTE=258, ATTRIBUTE1:DATA_QUOTA_TOTAL_RESULT_ATTRIBUTE_NAME=INQUIRY_BROWSAYA_DA
TA_TOTAL_QUOTA, ATTRIBUTE1:DATA_QUOTA_CONSUMED_RESULT_ATTRIBUTE_NAME=INQUIRY_BROWSAYA_DATA_CONSUMED_USAGE, ATTRIBUTE1:DATA_QUOTA_REMAINING_RESULT_ATTRIBUTE_NAME=IN
QUIRY_BROWSAYA_DATA_REMAINING_QUOTA, ATTRIBUTE1:DATA_QUOTA_MAX_VALUE_ATTRIBUTE=0, ATTRIBUTE1:DATA_QUOTA_RATE=0.05, ATTRIBUTE1:DATA_QUOTA_PERCENTAGE_RESULT_ATTRIBUT
E_NAME=INQUIRY_BROWSAYA_DATA_USAGE_PERCENTAGE}]
2019-07-02 16:00:00.640 [SUBSCRIBER_PROFILE-1152272177-4fb38876-4d08-4108-8b92-95f508c08d7d] attributeType [null], attributeValue [null], attributeSubValue [null],
 minValue [null], maxValue [null], measurementUnity [null]
2019-07-02 16:00:00.640 [SUBSCRIBER_PROFILE-1152272177-4fb38876-4d08-4108-8b92-95f508c08d7d] attributeType [DA], attributeValue [258], attributeSubValue [null], mi
nValue [null], maxValue [0], measurementUnity [null]
2019-07-02 16:00:00.640 [SUBSCRIBER_PROFILE-1152272177-4fb38876-4d08-4108-8b92-95f508c08d7d] ********************Inquiry Item [com.etisalat.oms.inquiry.actions.Dat
aQuotaInquiry] Executed successfully**************************
2019-07-02 16:00:00.640 [SUBSCRIBER_PROFILE-1152272177-4fb38876-4d08-4108-8b92-95f508c08d7d] Service Class [com.etisalat.oms.inquiry.actions.DataQuotaInquiry] load
ed Successfully.
2019-07-02 16:00:00.640 [SUBSCRIBER_PROFILE-1152272177-4fb38876-4d08-4108-8b92-95f508c08d7d] *************************** Starting Inquiry Item [com.etisalat.oms.in
quiry.actions.DataQuotaInquiry] *****************
2019-07-02 16:00:00.640 [SUBSCRIBER_PROFILE-1152272177-4fb38876-4d08-4108-8b92-95f508c08d7d] Starting DataQuotaInquiry.execute ...
2019-07-02 16:00:00.640 [SUBSCRIBER_PROFILE-1152272177-4fb38876-4d08-4108-8b92-95f508c08d7d] inquiryAttributesMap[{DATA_QUOTA_TYPE_ATTRIBUTE=UC, DATA_QUOTA_SUB_VAL
UE_ATTRIBUTE=85201, DATA_QUOTA_MIN_VALUE_ATTRIBUTE=0, DATA_QUOTA_VALUE_ATTRIBUTE=852}]
2019-07-02 16:00:00.640 [SUBSCRIBER_PROFILE-1152272177-4fb38876-4d08-4108-8b92-95f508c08d7d] attributeType [UC], attributeValue [852], attributeSubValue [85201], m
inValue [0], maxValue [null], measurementUnity [null]
2019-07-02 16:00:00.640 [SUBSCRIBER_PROFILE-1152272177-4fb38876-4d08-4108-8b92-95f508c08d7d] ********************Inquiry Item [com.etisalat.oms.inquiry.actions.Dat
aQuotaInquiry] Executed successfully**************************
2019-07-02 16:00:00.640 [SUBSCRIBER_PROFILE-1152272177-4fb38876-4d08-4108-8b92-95f508c08d7d] Service Class [com.etisalat.oms.inquiry.actions.NextRenewalDateInquiry
] loaded Successfully.
2019-07-02 16:00:00.640 [SUBSCRIBER_PROFILE-1152272177-4fb38876-4d08-4108-8b92-95f508c08d7d] *************************** Starting Inquiry Item [com.etisalat.oms.in
quiry.actions.NextRenewalDateInquiry] *****************
2019-07-02 16:00:00.640 [SUBSCRIBER_PROFILE-1152272177-4fb38876-4d08-4108-8b92-95f508c08d7d] Renewal Date Type [OFFER_ID] Renewal Date Type Value [15292] Addtional
 Days [1]
2019-07-02 16:00:00.640 [SUBSCRIBER_PROFILE-1152272177-4fb38876-4d08-4108-8b92-95f508c08d7d] ********************Inquiry Item [com.etisalat.oms.inquiry.actions.Nex
tRenewalDateInquiry] Executed successfully**************************
2019-07-02 16:00:00.640 [SUBSCRIBER_PROFILE-1152272177-4fb38876-4d08-4108-8b92-95f508c08d7d] Service Class [com.etisalat.oms.inquiry.actions.VoiceMinutesCrossNetIn
quiry] loaded Successfully.
2019-07-02 16:00:00.640 [SUBSCRIBER_PROFILE-1152272177-4fb38876-4d08-4108-8b92-95f508c08d7d] *************************** Starting Inquiry Item [com.etisalat.oms.in
quiry.actions.VoiceMinutesCrossNetInquiry] *****************
2019-07-02 16:00:00.640 [SUBSCRIBER_PROFILE-1152272177-4fb38876-4d08-4108-8b92-95f508c08d7d] Starting VoiceMinutesCrossNetInquiry.execute ...
2019-07-02 16:00:00.640 [SUBSCRIBER_PROFILE-1152272177-4fb38876-4d08-4108-8b92-95f508c08d7d] attributeType [null], attributeValue [null], attributeSubValue [null],
 minValue [null], maxValue [null]
2019-07-02 16:00:00.640 [SUBSCRIBER_PROFILE-1152272177-4fb38876-4d08-4108-8b92-95f508c08d7d] attributeType [null], attributeValue [null], attributeSubValue [null],
 minValue [null], maxValue [null]
2019-07-02 16:00:00.640 [SUBSCRIBER_PROFILE-1152272177-4fb38876-4d08-4108-8b92-95f508c08d7d] attributeType [null], attributeValue [null], attributeSubValue [null],
 minValue [null], maxValue [null]
2019-07-02 16:00:00.640 [SUBSCRIBER_PROFILE-1152272177-4fb38876-4d08-4108-8b92-95f508c08d7d] attributeType [null], attributeValue [null], attributeSubValue [null],
 minValue [null], maxValue [null]
2019-07-02 16:00:00.640 [SUBSCRIBER_PROFILE-1152272177-4fb38876-4d08-4108-8b92-95f508c08d7d] attributeType [null], attributeValue [null], attributeSubValue [null],
 minValue [null], maxValue [null]
2019-07-02 16:00:00.640 [SUBSCRIBER_PROFILE-1152272177-4fb38876-4d08-4108-8b92-95f508c08d7d] attributeType [null], attributeValue [null], attributeSubValue [null],
 minValue [null], maxValue [null]
2019-07-02 16:00:00.640 [SUBSCRIBER_PROFILE-1152272177-4fb38876-4d08-4108-8b92-95f508c08d7d] attributeType [null], attributeValue [null], attributeSubValue [null],
 minValue [null], maxValue [null]
2019-07-02 16:00:00.640 [SUBSCRIBER_PROFILE-1152272177-4fb38876-4d08-4108-8b92-95f508c08d7d] attributeType [null], attributeValue [null], attributeSubValue [null],
 minValue [null], maxValue [null]
2019-07-02 16:00:00.640 [SUBSCRIBER_PROFILE-1152272177-4fb38876-4d08-4108-8b92-95f508c08d7d] attributeType [null], attributeValue [null], attributeSubValue [null],
 minValue [null], maxValue [null]
2019-07-02 16:00:00.640 [SUBSCRIBER_PROFILE-1152272177-4fb38876-4d08-4108-8b92-95f508c08d7d] ********************Inquiry Item [com.etisalat.oms.inquiry.actions.Voi
ceMinutesCrossNetInquiry] Executed successfully**************************
2019-07-02 16:00:00.640 [SUBSCRIBER_PROFILE-1152272177-4fb38876-4d08-4108-8b92-95f508c08d7d] Service Class [com.etisalat.oms.inquiry.actions.OfferInquiry] loaded S
uccessfully.
2019-07-02 16:00:00.640 [SUBSCRIBER_PROFILE-1152272177-4fb38876-4d08-4108-8b92-95f508c08d7d] *************************** Starting Inquiry Item [com.etisalat.oms.in
quiry.actions.OfferInquiry] *****************
2019-07-02 16:00:00.640 [SUBSCRIBER_PROFILE-1152272177-4fb38876-4d08-4108-8b92-95f508c08d7d] ********************Inquiry Item [com.etisalat.oms.inquiry.actions.Off
erInquiry] Executed successfully**************************
2019-07-02 16:00:00.640 [SUBSCRIBER_PROFILE-1152272177-4fb38876-4d08-4108-8b92-95f508c08d7d] Service Class [com.etisalat.oms.inquiry.actions.StaticValuesInquiry] l
oaded Successfully.
2019-07-02 16:00:00.640 [SUBSCRIBER_PROFILE-1152272177-4fb38876-4d08-4108-8b92-95f508c08d7d] *************************** Starting Inquiry Item [com.etisalat.oms.in
quiry.actions.StaticValuesInquiry] *****************
2019-07-02 16:00:00.640 [SUBSCRIBER_PROFILE-1152272177-4fb38876-4d08-4108-8b92-95f508c08d7d] Starting StaticValuesInquiry.execute ...
2019-07-02 16:00:00.640 [SUBSCRIBER_PROFILE-1152272177-4fb38876-4d08-4108-8b92-95f508c08d7d] name[CAN_DISTRIBUTE], value[TRUE]
2019-07-02 16:00:00.640 [SUBSCRIBER_PROFILE-1152272177-4fb38876-4d08-4108-8b92-95f508c08d7d] ********************Inquiry Item [com.etisalat.oms.inquiry.actions.Sta
ticValuesInquiry] Executed successfully**************************
2019-07-02 16:00:00.640 [SUBSCRIBER_PROFILE-1152272177-4fb38876-4d08-4108-8b92-95f508c08d7d] Service Class [com.etisalat.oms.inquiry.actions.IsParentInquiry] loade
d Successfully.
2019-07-02 16:00:00.640 [SUBSCRIBER_PROFILE-1152272177-4fb38876-4d08-4108-8b92-95f508c08d7d] *************************** Starting Inquiry Item [com.etisalat.oms.in
quiry.actions.IsParentInquiry] *****************
2019-07-02 16:00:00.640 [SUBSCRIBER_PROFILE-1152272177-4fb38876-4d08-4108-8b92-95f508c08d7d] Starting isParentInquiry.execute ...
2019-07-02 16:00:00.640 [SUBSCRIBER_PROFILE-1152272177-4fb38876-4d08-4108-8b92-95f508c08d7d] ********************Inquiry Item [com.etisalat.oms.inquiry.actions.IsP
arentInquiry] Executed successfully**************************
2019-07-02 16:00:00.640 [SUBSCRIBER_PROFILE-1152272177-4fb38876-4d08-4108-8b92-95f508c08d7d] Service Class [com.etisalat.oms.inquiry.actions.FixedValueAction] load
ed Successfully.
2019-07-02 16:00:00.640 [SUBSCRIBER_PROFILE-1152272177-4fb38876-4d08-4108-8b92-95f508c08d7d] *************************** Starting Inquiry Item [com.etisalat.oms.in
quiry.actions.FixedValueAction] *****************
2019-07-02 16:00:00.640 [SUBSCRIBER_PROFILE-1152272177-4fb38876-4d08-4108-8b92-95f508c08d7d] inquiryAttributeList : [com.etisalat.oms.inquiry.model.InquiryAttribut
e@62844b36, com.etisalat.oms.inquiry.model.InquiryAttribute@510a9f07, com.etisalat.oms.inquiry.model.InquiryAttribute@a2b55d8]
2019-07-02 16:00:00.640 [SUBSCRIBER_PROFILE-1152272177-4fb38876-4d08-4108-8b92-95f508c08d7d] ********************Inquiry Item [com.etisalat.oms.inquiry.actions.Fix
edValueAction] Executed successfully**************************
2019-07-02 16:00:00.640 [SUBSCRIBER_PROFILE-1152272177-4fb38876-4d08-4108-8b92-95f508c08d7d] Service Class [com.etisalat.oms.inquiry.actions.GeneralUnitsInquiry] l
oaded Successfully.
2019-07-02 16:00:00.640 [SUBSCRIBER_PROFILE-1152272177-4fb38876-4d08-4108-8b92-95f508c08d7d] *************************** Starting Inquiry Item [com.etisalat.oms.in
quiry.actions.GeneralUnitsInquiry] *****************
2019-07-02 16:00:00.640 [SUBSCRIBER_PROFILE-1152272177-4fb38876-4d08-4108-8b92-95f508c08d7d] Starting GeneralUnitsInquiry.execute ...
2019-07-02 16:00:00.640 [SUBSCRIBER_PROFILE-1152272177-4fb38876-4d08-4108-8b92-95f508c08d7d] attributeType[null], attributeValue[null], attributeMinValue[null], at
tributeMaxValue[null], attributeSubValue[null]
2019-07-02 16:00:00.640 [SUBSCRIBER_PROFILE-1152272177-4fb38876-4d08-4108-8b92-95f508c08d7d] No Usage Counter Found
2019-07-02 16:00:00.641 [SUBSCRIBER_PROFILE-1152272177-4fb38876-4d08-4108-8b92-95f508c08d7d] attributeType[UC], attributeValue[713], attributeMinValue[0], attribut
eMaxValue[null], attributeSubValue[71302]
2019-07-02 16:00:00.641 [SUBSCRIBER_PROFILE-1152272177-4fb38876-4d08-4108-8b92-95f508c08d7d] attributeType[UC], attributeValue[713], attributeMinValue[0], attribut
eMaxValue[null], attributeSubValue[71301]
2019-07-02 16:00:00.641 [SUBSCRIBER_PROFILE-1152272177-4fb38876-4d08-4108-8b92-95f508c08d7d] attributeType[UC], attributeValue[956], attributeMinValue[0], attribut
eMaxValue[null], attributeSubValue[95601]
2019-07-02 16:00:00.641 [SUBSCRIBER_PROFILE-1152272177-4fb38876-4d08-4108-8b92-95f508c08d7d] attributeType[UC], attributeValue[809], attributeMinValue[0], attribut
eMaxValue[null], attributeSubValue[80901]
2019-07-02 16:00:00.641 [SUBSCRIBER_PROFILE-1152272177-4fb38876-4d08-4108-8b92-95f508c08d7d] ********************Inquiry Item [com.etisalat.oms.inquiry.actions.Gen
eralUnitsInquiry] Executed successfully**************************
2019-07-02 16:00:00.641 [SUBSCRIBER_PROFILE-1152272177-4fb38876-4d08-4108-8b92-95f508c08d7d] Service Class [com.etisalat.oms.inquiry.actions.PersonalBalanceInquiry
] loaded Successfully.
2019-07-02 16:00:00.641 [SUBSCRIBER_PROFILE-1152272177-4fb38876-4d08-4108-8b92-95f508c08d7d] *************************** Starting Inquiry Item [com.etisalat.oms.in
quiry.actions.PersonalBalanceInquiry] *****************
2019-07-02 16:00:00.641 [SUBSCRIBER_PROFILE-1152272177-4fb38876-4d08-4108-8b92-95f508c08d7d] Personal Balance Type [null]
2019-07-02 16:00:00.641 [SUBSCRIBER_PROFILE-1152272177-4fb38876-4d08-4108-8b92-95f508c08d7d] ********************Inquiry Item [com.etisalat.oms.inquiry.actions.Per
sonalBalanceInquiry] Executed successfully**************************
2019-07-02 16:00:00.641 [SUBSCRIBER_PROFILE-1152272177-4fb38876-4d08-4108-8b92-95f508c08d7d] Service Class [com.etisalat.oms.inquiry.actions.FafListInquiry] loaded
 Successfully.
2019-07-02 16:00:00.641 [SUBSCRIBER_PROFILE-1152272177-4fb38876-4d08-4108-8b92-95f508c08d7d] *************************** Starting Inquiry Item [com.etisalat.oms.in
quiry.actions.FafListInquiry] *****************

i want each message in graylog start with date/time

for ex. below is a message

  2019-07-02 16:00:00.641 [SUBSCRIBER_PROFILE-1152272177-4fb38876-4d08-4108-8b92-95f508c08d7d] *************************** Starting Inquiry Item [com.etisalat.oms.in
    quiry.actions.FafListInquiry] *****************

I used filebeat multiline option with below configuration

  multiline.pattern: ^\[[0-9]{4}-[0-9]{2}-[0-9]{2}

  # Defines if the pattern set under pattern should be negated or not. Default is false.
  multiline.negate: false

  # Match can be set to "after" or "before". It is used to define if lines should be append to a pattern
  # that was (not) matched before or after or as long as a pattern is not matched based on negate.
  # Note: After is the equivalent to previous and before is the equivalent to to next in Logstash
  multiline.match: after

But unfortunately , some messages begin with date and other messages not begin with date like attached screen shot.

graylog_messages
graylog_messages.png1600×900 160 KB

2

your multiline pattern is wrong

  multiline.pattern: ^\[[0-9]{4}-[0-9]{2}-[0-9]{2}

that is yours, but your messages do no start with a [ they start directly with the date - means the pattern needs to be

  multiline.pattern: ^[0-9]{4}-[0-9]{2}-[0-9]{2}
3

Thanks ,but unfortunately ,the issue still exists as per attached screenshots :

graylog_messages3
graylog_messages3.png1151×744 39.8 KB
graylog_messages2
graylog_messages2.png1124×744 40.9 KB

4

Also,below chunk of log comes on separate events,while ,i want it to come in one event:

2019-07-02 16:00:00.400 [ELIGIBLE_PRODUCT-1122220199-4b666699-b9b0-4549-8aff-537b199e040d] Error While Processing Request [<?xml version="1.0" encoding="UTF-8"?>
<eligibleProductsRequest>
    <channel>myEtisalatApp</channel>
    <extraRequestParameters>
        <name>INTERACTION_POINT</name>
        <value>meaHomePage</value>
    </extraRequestParameters>
    <extraRequestParameters>
        <name>APP_LANGUAGE</name>
        <value>EN</value>
    </extraRequestParameters>
    <extraRequestParameters>
        <name>APP_VERSION</name>
        <value>9</value>
    </extraRequestParameters>
    <requestType>BEST_OFFER</requestType>
    <transactionId>860acdaa2fc04ca88c7016d4f56b083d</transactionId>
    <msisdn>1122220199</msisdn>
</eligibleProductsRequest>
].
 com.etisalat.oms.exception.ApplicationException: No eligible product  configured for this dial [1122220199]
        at com.etisalat.oms.inquiry.manager.GenericProductEligibility.postValidate(GenericProductEligibility.java:72) ~[oms.jar:?]
        at com.etisalat.oms.inquiry.manager.GenericProductEligibility.getEligibleProduct(GenericProductEligibility.java:42) ~[oms.jar:?]
        at com.etisalat.oms.interfaces.service.ProductManagementService.getEligibleProducts(ProductManagementService.java:179) ~[oms.jar:?]
        at com.etisalat.oms.interfaces.product.EligibleProductsHandler.handle(EligibleProductsHandler.java:47) [oms.jar:?]
        at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1115) [jetty-all-9.3.1.v20150714-uber.jar:9.3.1.v20150714]
        at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1051) [jetty-all-9.3.1.v20150714-uber.jar:9.3.1.v20150714]
        at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) [jetty-all-9.3.1.v20150714-uber.jar:9.3.1.v20150714]
        at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:213) [jetty-all-9.3.1.v20150714-uber.jar:9.3.1.v20150714]
        at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:119) [jetty-all-9.3.1.v20150714-uber.jar:9.3.1.v20150714]
        at org.eclipse.jetty.server.Server.handle(Server.java:517) [jetty-all-9.3.1.v20150714-uber.jar:9.3.1.v20150714]
        at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:302) [jetty-all-9.3.1.v20150714-uber.jar:9.3.1.v20150714]
        at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:242) [jetty-all-9.3.1.v20150714-uber.jar:9.3.1.v20150714]
        at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:238) [jetty-all-9.3.1.v20150714-uber.jar:9.3.1.v20150714]
        at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:95) [jetty-all-9.3.1.v20150714-uber.jar:9.3.1.v20150714]
        at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:57) [jetty-all-9.3.1.v20150714-uber.jar:9.3.1.v20150714]
        at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceAndRun(ExecuteProduceConsume.java:213) [jetty-all-9.3.1.v20150714-uber.jar:9.3.1.v20150714]
        at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:147) [jetty-all-9.3.1.v20150714-uber.jar:9.3.1.v20150714]
        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:654) [jetty-all-9.3.1.v20150714-uber.jar:9.3.1.v20150714]
        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:572) [jetty-all-9.3.1.v20150714-uber.jar:9.3.1.v20150714]
        at java.lang.Thread.run(Thread.java:745) [?:1.8.0_65]
5

Hi All,

Any updates on my post …

6

this is the community board, all help is done in the spare time …

From the given information it should work, if it does not - provide information. What have you configured and how did you verified that this configuration is the one that is working?

7

Hi Jan,

I verified this by taking one sample log and put it on the filebeat directory ,then preview processed messages in graylog application.

Also ,I used below URL to test my Regex:

https://play.golang.org/

8

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.