Mixing
How to collect access logs from different nodes?
We have a lot of nodes (about 18) on Production, and it is necessary to find out if the specific user made requests from the mobile app (access logs have this info).
SAP Hybris doesn't store such info in the database, so it is necessary to search the logs. Each node has a file like log/tomcat/access.2018-11-22.log. It would be unreasonable to check each file manually.
Maybe there is a well-known solution for the situations like this?
java logging cluster-computing hybris
edited Nov 26 '18 at 4:22
HybrisHelp
2,93111345
asked Nov 22 '18 at 13:43
Iaroslav BaranovIaroslav Baranov
378312
add a comment |
We have a lot of nodes (about 18) on Production, and it is necessary to find out if the specific user made requests from the mobile app (access logs have this info).
SAP Hybris doesn't store such info in the database, so it is necessary to search the logs. Each node has a file like log/tomcat/access.2018-11-22.log. It would be unreasonable to check each file manually.
Maybe there is a well-known solution for the situations like this?
java logging cluster-computing hybris
edited Nov 26 '18 at 4:22
HybrisHelp
2,93111345
asked Nov 22 '18 at 13:43
Iaroslav BaranovIaroslav Baranov
378312
This might also be helpful: stackoverflow.com/questions/83741/…
– John Camerin
Nov 22 '18 at 14:10
add a comment |
We have a lot of nodes (about 18) on Production, and it is necessary to find out if the specific user made requests from the mobile app (access logs have this info).
SAP Hybris doesn't store such info in the database, so it is necessary to search the logs. Each node has a file like log/tomcat/access.2018-11-22.log. It would be unreasonable to check each file manually.
Maybe there is a well-known solution for the situations like this?
java logging cluster-computing hybris
edited Nov 26 '18 at 4:22
HybrisHelp
2,93111345
asked Nov 22 '18 at 13:43
Iaroslav BaranovIaroslav Baranov
378312
We have a lot of nodes (about 18) on Production, and it is necessary to find out if the specific user made requests from the mobile app (access logs have this info).
SAP Hybris doesn't store such info in the database, so it is necessary to search the logs. Each node has a file like log/tomcat/access.2018-11-22.log. It would be unreasonable to check each file manually.
Maybe there is a well-known solution for the situations like this?
java logging cluster-computing hybris
java logging cluster-computing hybris
edited Nov 26 '18 at 4:22
HybrisHelp
2,93111345
asked Nov 22 '18 at 13:43
Iaroslav BaranovIaroslav Baranov
378312
edited Nov 26 '18 at 4:22
HybrisHelp
2,93111345
asked Nov 22 '18 at 13:43
Iaroslav BaranovIaroslav Baranov
378312
edited Nov 26 '18 at 4:22
HybrisHelp
2,93111345
edited Nov 26 '18 at 4:22
HybrisHelp
2,93111345
edited Nov 26 '18 at 4:22
HybrisHelp
2,93111345
2,93111345
asked Nov 22 '18 at 13:43
Iaroslav BaranovIaroslav Baranov
378312
asked Nov 22 '18 at 13:43
Iaroslav BaranovIaroslav Baranov
378312
asked Nov 22 '18 at 13:43
Iaroslav BaranovIaroslav Baranov
378312
378312
This might also be helpful: stackoverflow.com/questions/83741/…
– John Camerin
Nov 22 '18 at 14:10
add a comment |
This might also be helpful: stackoverflow.com/questions/83741/…
– John Camerin
Nov 22 '18 at 14:10
This might also be helpful: stackoverflow.com/questions/83741/…
– John Camerin
Nov 22 '18 at 14:10
This might also be helpful: stackoverflow.com/questions/83741/…
– John Camerin
Nov 22 '18 at 14:10
add a comment |
6 Answers
6
active
oldest
votes
There are 3rd party solutions such as Splunk and ELK which will collect the data from log files.
answered Nov 22 '18 at 14:06
John CamerinJohn Camerin
436211
add a comment |
Take a look on it
Its a ELK stack, very common and easy to use in production
answered Nov 22 '18 at 17:23
Ihar SadounikauIhar Sadounikau
424312
add a comment |
If you want to use a tool then i would recommend to use Splunk else you can log request in database as per the requirements.
If you can share the requirements in detail then i am happy to help you providing better solution.
answered Nov 22 '18 at 18:10
user3624540user3624540
364
add a comment |
We are developing micro service projects and have about 20 services. All the services connect to ELK(Elastic search,Logstash,Kibana). We are viewing all the log though Kibana.It is very easy make queries to search what we want.
answered Nov 23 '18 at 15:03
WGSSAMINTHAWGSSAMINTHA
10210
add a comment |
If you're interested, Hybris Help also has a guide on how to setup B2C Accelerator in a Docker Container with Centralized Logging: https://help.hybris.com/1808/hcd/af36215ea1e34c22a1e3cbb2d550f733.html
answered Nov 25 '18 at 1:37
geffchanggeffchang
82111741
add a comment |
Use ELK - elasticsearch logstash and kibana stack with filebeat.
Filebeat -will share the log file content with logstash
Logstash-will scan, filter and share the needed content to elastic search
Elasticsearch- will work as a db, store the content from logstash in json format as documents.
Kibana- with kibana you can search the required info. Also you can plot graphs and other visuals with the relevant data.
answered Nov 26 '18 at 16:04
Vineet SharmaVineet Sharma
514
add a comment |
Your Answer
StackExchange.ifUsing("editor", function () {
StackExchange.using("externalEditor", function () {
StackExchange.using("snippets", function () {
StackExchange.snippets.init();
});
});
}, "code-snippets");
StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "1"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});
function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});
}
});
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53432330%2fhow-to-collect-access-logs-from-different-nodes%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
6 Answers
6
active
oldest
votes
6 Answers
6
active
oldest
votes
active
oldest
votes
active
oldest
votes
There are 3rd party solutions such as Splunk and ELK which will collect the data from log files.
answered Nov 22 '18 at 14:06
John CamerinJohn Camerin
436211
add a comment |
There are 3rd party solutions such as Splunk and ELK which will collect the data from log files.
answered Nov 22 '18 at 14:06
John CamerinJohn Camerin
436211
add a comment |
There are 3rd party solutions such as Splunk and ELK which will collect the data from log files.
answered Nov 22 '18 at 14:06
John CamerinJohn Camerin
436211
There are 3rd party solutions such as Splunk and ELK which will collect the data from log files.
answered Nov 22 '18 at 14:06
John CamerinJohn Camerin
436211
answered Nov 22 '18 at 14:06
John CamerinJohn Camerin
436211
answered Nov 22 '18 at 14:06
John CamerinJohn Camerin
436211
answered Nov 22 '18 at 14:06
John CamerinJohn Camerin
436211
436211
add a comment |
add a comment |
Take a look on it
Its a ELK stack, very common and easy to use in production
answered Nov 22 '18 at 17:23
Ihar SadounikauIhar Sadounikau
424312
add a comment |
Take a look on it
Its a ELK stack, very common and easy to use in production
answered Nov 22 '18 at 17:23
Ihar SadounikauIhar Sadounikau
424312
add a comment |
Take a look on it
Its a ELK stack, very common and easy to use in production
answered Nov 22 '18 at 17:23
Ihar SadounikauIhar Sadounikau
424312
Take a look on it
Its a ELK stack, very common and easy to use in production
answered Nov 22 '18 at 17:23
Ihar SadounikauIhar Sadounikau
424312
answered Nov 22 '18 at 17:23
Ihar SadounikauIhar Sadounikau
424312
answered Nov 22 '18 at 17:23
Ihar SadounikauIhar Sadounikau
424312
answered Nov 22 '18 at 17:23
Ihar SadounikauIhar Sadounikau
424312
424312
add a comment |
add a comment |
If you want to use a tool then i would recommend to use Splunk else you can log request in database as per the requirements.
If you can share the requirements in detail then i am happy to help you providing better solution.
answered Nov 22 '18 at 18:10
user3624540user3624540
364
add a comment |
If you want to use a tool then i would recommend to use Splunk else you can log request in database as per the requirements.
If you can share the requirements in detail then i am happy to help you providing better solution.
answered Nov 22 '18 at 18:10
user3624540user3624540
364
add a comment |
If you want to use a tool then i would recommend to use Splunk else you can log request in database as per the requirements.
If you can share the requirements in detail then i am happy to help you providing better solution.
answered Nov 22 '18 at 18:10
user3624540user3624540
364
If you want to use a tool then i would recommend to use Splunk else you can log request in database as per the requirements.
If you can share the requirements in detail then i am happy to help you providing better solution.
answered Nov 22 '18 at 18:10
user3624540user3624540
364
answered Nov 22 '18 at 18:10
user3624540user3624540
364
answered Nov 22 '18 at 18:10
user3624540user3624540
364
answered Nov 22 '18 at 18:10
user3624540user3624540
364
364
add a comment |
add a comment |
We are developing micro service projects and have about 20 services. All the services connect to ELK(Elastic search,Logstash,Kibana). We are viewing all the log though Kibana.It is very easy make queries to search what we want.
answered Nov 23 '18 at 15:03
WGSSAMINTHAWGSSAMINTHA
10210
add a comment |
We are developing micro service projects and have about 20 services. All the services connect to ELK(Elastic search,Logstash,Kibana). We are viewing all the log though Kibana.It is very easy make queries to search what we want.
answered Nov 23 '18 at 15:03
WGSSAMINTHAWGSSAMINTHA
10210
add a comment |
We are developing micro service projects and have about 20 services. All the services connect to ELK(Elastic search,Logstash,Kibana). We are viewing all the log though Kibana.It is very easy make queries to search what we want.
answered Nov 23 '18 at 15:03
WGSSAMINTHAWGSSAMINTHA
10210
We are developing micro service projects and have about 20 services. All the services connect to ELK(Elastic search,Logstash,Kibana). We are viewing all the log though Kibana.It is very easy make queries to search what we want.
answered Nov 23 '18 at 15:03
WGSSAMINTHAWGSSAMINTHA
10210
answered Nov 23 '18 at 15:03
WGSSAMINTHAWGSSAMINTHA
10210
answered Nov 23 '18 at 15:03
WGSSAMINTHAWGSSAMINTHA
10210
answered Nov 23 '18 at 15:03
WGSSAMINTHAWGSSAMINTHA
10210
10210
add a comment |
add a comment |
If you're interested, Hybris Help also has a guide on how to setup B2C Accelerator in a Docker Container with Centralized Logging: https://help.hybris.com/1808/hcd/af36215ea1e34c22a1e3cbb2d550f733.html
answered Nov 25 '18 at 1:37
geffchanggeffchang
82111741
add a comment |
If you're interested, Hybris Help also has a guide on how to setup B2C Accelerator in a Docker Container with Centralized Logging: https://help.hybris.com/1808/hcd/af36215ea1e34c22a1e3cbb2d550f733.html
answered Nov 25 '18 at 1:37
geffchanggeffchang
82111741
add a comment |
If you're interested, Hybris Help also has a guide on how to setup B2C Accelerator in a Docker Container with Centralized Logging: https://help.hybris.com/1808/hcd/af36215ea1e34c22a1e3cbb2d550f733.html
answered Nov 25 '18 at 1:37
geffchanggeffchang
82111741
If you're interested, Hybris Help also has a guide on how to setup B2C Accelerator in a Docker Container with Centralized Logging: https://help.hybris.com/1808/hcd/af36215ea1e34c22a1e3cbb2d550f733.html
answered Nov 25 '18 at 1:37
geffchanggeffchang
82111741
answered Nov 25 '18 at 1:37
geffchanggeffchang
82111741
answered Nov 25 '18 at 1:37
geffchanggeffchang
82111741
answered Nov 25 '18 at 1:37
geffchanggeffchang
82111741
82111741
add a comment |
add a comment |
Use ELK - elasticsearch logstash and kibana stack with filebeat.
Filebeat -will share the log file content with logstash
Logstash-will scan, filter and share the needed content to elastic search
Elasticsearch- will work as a db, store the content from logstash in json format as documents.
Kibana- with kibana you can search the required info. Also you can plot graphs and other visuals with the relevant data.
answered Nov 26 '18 at 16:04
Vineet SharmaVineet Sharma
514
add a comment |
Use ELK - elasticsearch logstash and kibana stack with filebeat.
Filebeat -will share the log file content with logstash
Logstash-will scan, filter and share the needed content to elastic search
Elasticsearch- will work as a db, store the content from logstash in json format as documents.
Kibana- with kibana you can search the required info. Also you can plot graphs and other visuals with the relevant data.
answered Nov 26 '18 at 16:04
Vineet SharmaVineet Sharma
514
add a comment |
Use ELK - elasticsearch logstash and kibana stack with filebeat.
Filebeat -will share the log file content with logstash
Logstash-will scan, filter and share the needed content to elastic search
Elasticsearch- will work as a db, store the content from logstash in json format as documents.
Kibana- with kibana you can search the required info. Also you can plot graphs and other visuals with the relevant data.
answered Nov 26 '18 at 16:04
Vineet SharmaVineet Sharma
514
Use ELK - elasticsearch logstash and kibana stack with filebeat.
Filebeat -will share the log file content with logstash
Logstash-will scan, filter and share the needed content to elastic search
Elasticsearch- will work as a db, store the content from logstash in json format as documents.
Kibana- with kibana you can search the required info. Also you can plot graphs and other visuals with the relevant data.
answered Nov 26 '18 at 16:04
Vineet SharmaVineet Sharma
514
answered Nov 26 '18 at 16:04
Vineet SharmaVineet Sharma
514
answered Nov 26 '18 at 16:04
Vineet SharmaVineet Sharma
514
answered Nov 26 '18 at 16:04
Vineet SharmaVineet Sharma
514
514
add a comment |
add a comment |
Thanks for contributing an answer to Stack Overflow!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53432330%2fhow-to-collect-access-logs-from-different-nodes%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
This might also be helpful: stackoverflow.com/questions/83741/…
– John Camerin
Nov 22 '18 at 14:10