Custom periods with period detector

CorText Manager Q&A forumCategory: Time processingCustom periods with period detector
Yuri Saldarriaga asked 3 years ago

Hi!
I have two projects with different data but the same analysis. In both projects, I need to run a period detector script. However, although I have done the same processes in both projects, I could only get the period detector in one of them. I even did the process all over again, but it seems to fail in the detection of periods. Do you have any piece of advice for me? I don’t understand why I could do it in one project and not in the other, because I’m using exactly the same processes. 
Thank you!
This is the script log of the project where the period detector works:

2022-05-10 04:03:12 INFO : Script Period Detector Started
2022-05-10 04:03:12 INFO : 
                           Period slices definition:
                                                         Fields:
                                                         - Terms
                                                         Enter the number of periods you wish to detect: '0'
                                                         Top items: '500'
                                                         Choose Original Timescale: Standard Periods
                           
2022-05-10 04:03:12 INFO : Reading data
2022-05-10 04:03:12 INFO : Create a per timestep profile
2022-05-10 04:03:12 INFO : Matrix of changes computed
2022-05-10 04:03:12 INFO : Periods detected
2022-05-10 04:03:12 INFO : Periods detected:{0: [2, 3, 5, 7, 8, 10, 14, 15, 16]}
2022-05-10 04:03:12 INFO : Drawing the final matrix
2022-05-10 04:03:12 DEBUG : findfont: Matching :family=sans-serif:style=normal:variant=normal:weight=normal:stretch=normal:size=10.0 to DejaVu Sans (u'/usr/local/lib/python2.7/dist-packages/matplotlib/mpl-data/fonts/ttf/DejaVuSans.ttf') with score of 0.050000
2022-05-10 04:03:12 DEBUG : Assigning font /F1 = u'/usr/local/lib/python2.7/dist-packages/matplotlib/mpl-data/fonts/ttf/DejaVuSans.ttf'
2022-05-10 04:03:12 DEBUG : Embedding font /usr/local/lib/python2.7/dist-packages/matplotlib/mpl-data/fonts/ttf/DejaVuSans.ttf.
2022-05-10 04:03:12 DEBUG : Writing TrueType font.
2022-05-10 04:03:12 INFO : Period Detector successfully ended

This is the script log of the project where the period detector does not work:

2022-05-10 22:32:05 INFO : Script Period Detector Started 2022-05-10 22:32:05 INFO : Period slices definition: Fields: - Terms Enter the number of periods you wish to detect: '7' Top items: '500' Choose Original Timescale: Standard Periods 2022-05-10 22:32:05 INFO : Reading data 2022-05-10 22:32:05 INFO : Create a per timestep profile 2022-05-10 22:32:05 INFO : Matrix of changes computed
Yuri Saldarriaga replied 3 years ago

Sorry, the script log of the project where the period detector does not work is this:

2022-05-11 00:46:51 INFO : Script Period Detector Started
2022-05-11 00:46:51 INFO :
Period slices definition:
Fields:
– Terms
Enter the number of periods you wish to detect: ‘0’
Top items: ‘500’
Choose Original Timescale: Standard Periods

2022-05-11 00:46:51 INFO : Reading data
2022-05-11 00:46:51 INFO : Create a per timestep profile
2022-05-11 00:46:51 INFO : Matrix of changes computed

2 Answers
Lionel Staff answered 3 years ago

Dear Yuri,
Please, could you invite me to your project: lionel dot villard at esiee dot fr ?
Best regards,
L

Lionel Staff answered 3 years ago

Dear Yuri,
From what I see after a quick investigation:

  • You have 7 distinct documents
  • Each of them has a different date (I do not know what your dates represent), so 7 distinct dates.
  • 3529 couples document X extracted keywords

So, this makes me think that it is due to the fact that you want to detect as many periods as the number of dates you have in your corpus. Indeed, if you search for 7 periods, each date is a period, which is not the purpose of the period detector. So no need to use period detector 😊
I hope it helps
L