Regex pattern in Python

Question

I'm looking for a pattern in Regex in Python to do the following:

For a text formatted like:

2021-01-01 10:00:05 - Surname1 Name1 (Comment)
Blablabla
Blabla
2021-01-01 23:00:05 - Surname2 SurnameBis Name2 (WorkNotes)
What?
I don't know?
2021-01-02 03:00:05 - Surname1 Name1 (Comment)
Blablabla!

I would like to return:

[(2021-01-01,10:00:05,Surname1 Name1,Comment,Blablabla/nBlabla),
(2021-01-01,23:00:05,Surname2 SurnameBis Name2,WorkNotes,What?/nI don't know?),
(2021-01-02,03:00:05,Surname1 Name1,Comment,Blablabla!)]

I managed to find a quiet close result with:

text2 = """2021-01-01 10:00:05 - Surname1 Name1 (Comment)
Blablabla
Blabla
2021-01-01 23:00:05 - Surname2 SurnameBis Name2 (WorkNotes)
What?
I don't know?
Can you be clear?
2021-01-02 03:00:05 - Surname1 Name1 (Comment)
Blablabla!"""
LangTag = re.findall("(\d{4}-\d{2}-\d{2})\s(\d{2}:\d{2}:\d{2})\s-\s(.*?)\((.*)\)\\n(.*)(?:\\n|$)", text2)
print(LangTag)

But I'm totally stuck to make appears the entire text I need to get...

a solution can be to remove the \n from initial text but, I would like to avoid it because I need them later on... Any idea?

Leo · Accepted Answer · 2021-09-25 13:45:17Z

2

You can parse your data like this.

import re

data = """2021-01-01 10:00:05 - Surname1 Name1 (Comment)
Blablabla
Blabla
2021-01-01 23:00:05 - Surname2 SurnameBis Name2 (WorkNotes)
What?
I don't know?
2021-01-02 03:00:05 - Surname1 Name1 (Comment)
Blablabla!"""

def parse(data):
    text = ""
    match = None
    messages = []
    for line in data.split("\n"):
        m = re.match("^(\d{4}-\d{2}-\d{2}) (\d{2}:\d{2}:\d{2}) - (.*?) \((.*?)\)$", line)
        if m:
            if match:
                msg = (match.group(1), match.group(2), match.group(3), match.group(4), text)
                messages.append(msg)
            match = m
        else:
            text += line + "\n"
    msg = (match.group(1), match.group(2), match.group(3), match.group(4), text)
    messages.append(msg)
    return messages

for message in parse(data):
    print(message)

This outputs

('2021-01-01', '10:00:05', 'Surname1 Name1', 'Comment', 'Blablabla\nBlabla\n')
('2021-01-01', '23:00:05', 'Surname2 SurnameBis Name2', 'WorkNotes', "Blablabla\nBlabla\nWhat?\nI don't know?\n")
('2021-01-02', '03:00:05', 'Surname1 Name1', 'Comment', "Blablabla\nBlabla\nWhat?\nI don't know?\nBlablabla!\n")

answered Sep 25, 2021 at 13:45

Leo

1,3039 silver badges14 bronze badges

Sign up to request clarification or add additional context in comments.

1 Comment

Renaud Over a year ago

Thanks I managed my problem with your answer.

adamkwm · Accepted Answer · 2021-09-25 14:37:04Z

1

My solution is almost the same as yours, but turning group 5 from .* to \D*, so it will match everything until the next number.

import re
text = """2021-01-01 10:00:05 - Surname1 Name1 (Comment)
Blablabla
Blabla
2021-01-01 23:00:05 - Surname2 SurnameBis Name2 (WorkNotes)
What?
I don't know?
2021-01-02 03:00:05 - Surname1 Name1 (Comment)
Blablabla!"""
result = re.findall(r"(\d{4}-\d{2}-\d{2})\s(\d{2}:\d{2}:\d{2})\s-\s(.*?)\((.*)\)\n(\D*)(?:\n|$)", text)
print(result)

Output:

[('2021-01-01', '10:00:05', 'Surname1 Name1 ', 'Comment', 'Blablabla\nBlabla'),
 ('2021-01-01', '23:00:05', 'Surname2 SurnameBis Name2 ', 'WorkNotes', "What?\nI don't know?"), 
 ('2021-01-02', '03:00:05', 'Surname1 Name1 ', 'Comment', 'Blablabla!')]

answered Sep 25, 2021 at 14:37

adamkwm

1,1712 gold badges9 silver badges18 bronze badges

1 Comment

Renaud Over a year ago

Thanks for your answer, my bad was than in exemple I provided there were no digit in text, but as it come from a textarea, I have many notes with digits inside which which aree skipped... I tried to adapt your answer to my cases, and I came back to same situation...

dragon2fly · Accepted Answer · 2021-09-25 14:46:55Z

You could approach your problem by solving for the first block. Then repeat the solution to the end of your data. By doing this divide and conquer strategy, the code is simple to understand and yet can solve the bigger problem and can be extended easily.

import re

data = '''2021-01-01 10:00:05 - Surname1 Name1 (Comment)
Blablabla
Blabla
2021-01-01 23:00:05 - Surname2 SurnameBis Name2 (WorkNotes)
What?
I don't know?
2021-01-02 03:00:05 - Surname1 Name1 (Comment)
Blablabla!'''.splitlines()

first_line_patt = re.compile(r'^(\d{4}-\d{2}-\d{2}) (\d{2}:\d{2}:\d{2}) - (.*)(?= \() \((.*)\)$')


def parse_block(lines, idx):
    # parse the meta line
    res = first_line_patt.findall(lines[idx])

    # get the message
    message = []
    while idx < len(lines)-1:
        line = lines[idx + 1]
        idx += 1

        # check if next line is a meta line
        if first_line_patt.match(line):
            break

        # if not, it is a message line
        message.append(line)

    res.append('\n'.join(message))
    return res, idx


idx = 0
while True:
    res, idx = parse_block(data, idx)
    if not res[0]:
        break
    print(res)

This produces the following result:

[('2021-01-01', '10:00:05', 'Surname1 Name1', 'Comment'), 'Blablabla\nBlabla']
[('2021-01-01', '23:00:05', 'Surname2 SurnameBis Name2', 'WorkNotes'), "What?\nI don't know?"]
[('2021-01-02', '03:00:05', 'Surname1 Name1', 'Comment'), 'Blablabla!']

balderman · Accepted Answer · 2021-09-25 13:55:25Z

Try the below.
The key point here is if line[0].isdigit() that is able to identify that a new section is starting.

Important note : this solution is removing the \n while it merges the sections.

data = '''2021-01-01 10:00:05 - Surname1 Name1 (Comment)
Blablabla
Blabla
2021-01-01 23:00:05 - Surname2 SurnameBis Name2 (WorkNotes)
What?
I don't know?
2021-01-02 03:00:05 - Surname1 Name1 (Comment)
Blablabla!'''


holder = []
lines = data.split('\n')
temp = []
for line in lines:
    if line[0].isdigit():
        if temp:
            holder.append(' '.join(temp))
            temp = []
    temp.append(line)
holder.append(' '.join(temp))

for line in holder:
    print(line)

output

2021-01-01 10:00:05 - Surname1 Name1 (Comment) Blablabla Blabla
2021-01-01 23:00:05 - Surname2 SurnameBis Name2 (WorkNotes) What? I don't know?
2021-01-02 03:00:05 - Surname1 Name1 (Comment) Blablabla!

The fourth bird · Accepted Answer · 2021-09-26 09:50:14Z

The lines after the Comment/WorkNotes can match all lines that do not start with a date like pattern using a negative lookahead by changing the last part of the pattern to:

((?:(?!\d{4}-\d{2}-\d{2}).*(?:\n|$))*)

For example

import re
 
text2 = """2021-01-01 10:00:05 - Surname1 Name1 (Comment)
Blablabla
Blabla
2021-01-01 23:00:05 - Surname2 SurnameBis Name2 (WorkNotes)
What?
I don't know?
Can you be clear?
2021-01-02 03:00:05 - Surname1 Name1 (Comment)
Blablabla!"""
LangTag = re.findall(r"(\d{4}-\d{2}-\d{2})\s(\d{2}:\d{2}:\d{2})\s-\s(.*?)\((.*)\)\n((?:(?!\d{4}-\d{2}-\d{2}).*(?:\n|$))*)", text2)
print(LangTag)

Output

[
('2021-01-01', '10:00:05', 'Surname1 Name1 ', 'Comment', 'Blablabla\nBlabla\n'), 
('2021-01-01', '23:00:05', 'Surname2 SurnameBis Name2 ', 'WorkNotes', "What?\nI don't know?\nCan you be clear?\n"), 
('2021-01-02', '03:00:05', 'Surname1 Name1 ', 'Comment', 'Blablabla!')
]

Regex demo | Python demo

Collectives™ on Stack Overflow

Regex pattern in Python

5 Answers 5

1 Comment

1 Comment

Comments

Comments

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

5 Answers 5

1 Comment

1 Comment

Comments

Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Related