---
name: AnalyticsEngine-viewing-logs
title: Overview
description: ''
last-updated: 2024-01-31
---

> ## Documentation Index
> The table of contents for this documentation set is at https://cloud.ibm.com/docs/AnalyticsEngine?format=markdown
> The index for all IBM Cloud docs is at: https://cloud.ibm.com/docs/llms.txt
> Use these files to discover more information as needed.

{:new_window: target="_blank"}
{:shortdesc: .shortdesc}
{:codeblock: .codeblock}
{:screen: .screen}
{:pre: .pre}
{:external: target="_blank" .external}

# Overview
{: #viewing-logs}

When you submit applications or Spark workloads in IBM Analytics Engine, you can monitor the application execution. IBM Analytics Engine allows to debug the application errors or trace the application execution by monitoring the application-generated logs and the Spark-generated logs. IBM Cloud Logs together with monitoring feature of the **Spark History** page provides better troubleshooting of the applications.

IBM Analytics Engine allows you to forward application logs to the **instance home** or (and) to IBM Cloud Logs service.

## Default Behavior
{: #viewing-logs_1}


When you run applications in IBM Analytics Engine, the application logs (only `Spark Driver WARN logs`) are forwarded to IBM Cloud Object Storage by default. You can access the log information from your **instance home**. For more information, see [instance home](https://cloud.ibm.com/docs/AnalyticsEngine?topic=AnalyticsEngine-cos-concepts&format=markdown).


## Forwarding logs to instance home
{: #viewing-logs-2}


Application Logs are forwarded to the Analytics Engine **instance home** by default. You can access the log information from the IBM Cloud Object Storage bucket. You can download the log file for any specific application from the Cloud Object Storage bucket for recording, sharing, and debugging purposes. If you want to change the default behavior to include executor logs or INFO logs for driver or executor, you need to change the configurations. For more information, see [Forwarding logs to instance home](https://cloud.ibm.com/docs/AnalyticsEngine?topic=AnalyticsEngine-viewing-logs_1&format=markdown).

## Forwarding logs to IBM Cloud Logs
{: #viewing-logs-3}


IBM Cloud Logs service allows you to view indexed logs, enable full-text search through all generated messages and query based on specific fields. Enabling the `log forwarding` feature forward the logs to IBM Cloud Logs service (in addition to **instance home**). Only the `Spark Driver WARN logs` are forwarded by default. To change the behavior to include executor logs, enable it by modifying the payload in the log forwarding API.For more information, see [Forwarding logs to IBM Cloud Logs](https://cloud.ibm.com/docs/AnalyticsEngine?topic=AnalyticsEngine-platform-logs&format=markdown)

## Changing the Spark Log Levels
{: #viewing-logs-4}


To change the default behavior to forward logs at different log levels (INFO, DEBUG, and so on), see [Configuring Spark log level information](https://cloud.ibm.com/docs/AnalyticsEngine?topic=AnalyticsEngine-config_log&format=markdown).


## Disabling Logging feature
{: #viewing-logs-5}


To disable sending log information to both **instance home** and IBM Cloud Logs, set the driver and executor log level configuration to OFF. For more information see, [Configuring Spark log level information](https://cloud.ibm.com/docs/AnalyticsEngine?topic=AnalyticsEngine-config_log&format=markdown).