ARTIFICIAL INTELLIGENCE-BASED LOG AUGMENTATION AND CLUSTERING
ARTIFICIAL INTELLIGENCE-BASED LOG AUGMENTATION AND CLUSTERING
A log system prompts a foundation model to identify regular expressions that delineate single line logs in log files and incorporates user feedback for the regular expressions in a feedback loop as part of a hybrid parsing approach. The log system splits the log files into single line logs according to the regular expressions and augments the single line logs with classifications and values of metadata fields. The augmented single line logs are then clustered into hierarchical clusters with corresponding cluster patterns and the log system stores the augmented single line logs in a database indexed by the classifications and values of metadata fields and associated with corresponding clusters/cluster patterns. A presentation module accesses the database when responding to user queries for filtered single line logs and log correlations/root cause analysis.