Postgrep: Difference between revisions
Jump to navigation
Jump to search
No edit summary |
|||
| Line 15: | Line 15: | ||
* How do we determine the year for each log entry? Could use current year, but what happens if we import logs from December and January? | * How do we determine the year for each log entry? Could use current year, but what happens if we import logs from December and January? | ||
* How do we identify Postfix log entries? | * How do we identify Postfix log entries? | ||
* Is it more efficient to process files line by line as we read them or slurp the file into a single variable and then iterate over that? | |||
[[Category:Python]] | [[Category:Python]] | ||
Latest revision as of 16:30, 6 February 2019
Script for searching through Postfix log files, effectively like exigrep but for Postfix instead of Exim.
Language choice
Use Python for speed of development and cross-platform code.
Features
- Specify multiple input files, will all be read and processed.
- Automatically decompress .gz files in memory before reading.
- Read all data into an SQLite 'in memory' file, which allows fast and detailed filtering.
Questions
- How do we determine the year for each log entry? Could use current year, but what happens if we import logs from December and January?
- How do we identify Postfix log entries?
- Is it more efficient to process files line by line as we read them or slurp the file into a single variable and then iterate over that?