summaryrefslogtreecommitdiffstats
path: root/src/lib/Server/Reports/importscript.py
Commit message (Collapse)AuthorAgeFilesLines
* New database field: "is_sensitive"Holger Weiß2011-06-291-2/+7
| | | | | | The new "entry.reason.is_sensitive" flag indicates whether the file contents/diffs were omitted from the database due to the "sensitive" <Path> attribute.
* Accept non-ASCII diffsHolger Weiß2011-06-061-3/+15
| | | | | | | Currently, client reports don't include diffs of files which aren't US-ASCII encoded. The client transmits such files as Base64 blobs. As we'd like to change that, this commit teaches the server to properly handle non-ASCII diffs.
* DBStats: Stop duplicating data in reports_reasonTim Laszlo2011-05-091-6/+3
|
* Consolidate PY3K compatibility librariesSol Jerome2011-04-261-2/+2
| | | | Signed-off-by: Sol Jerome <sol.jerome@gmail.com>
* Reports: Add full PY3K compatibilitySol Jerome2011-04-261-4/+9
| | | | | | | | Note that Django still doesn't yet support version 3 so this won't necessarily work until there is a compatible version of django available for use. Signed-off-by: Sol Jerome <sol.jerome@gmail.com>
* Reports: PY3K + PEP8 fixesSol Jerome2011-04-061-47/+69
| | | | Signed-off-by: Sol Jerome <sol.jerome@gmail.com>
* DBStats: Fix random mysql errorsTim Laszlo2010-07-301-12/+11
| | | | | | | | | Occasionally importing ping data would fail with "Commands out of sync; you can't run this command now". Improved logging and error handling for imports. Fixed indentation error in GetCurrentEntry git-svn-id: https://svn.mcs.anl.gov/repos/bcfg/trunk/bcfg2@5992 ce84e21b-d406-0410-9b95-82705330c041
* DBStats: Support for postgresqlTim Laszlo2010-07-161-82/+40
| | | | git-svn-id: https://svn.mcs.anl.gov/repos/bcfg/trunk/bcfg2@5975 ce84e21b-d406-0410-9b95-82705330c041
* DBStats: Improved handling of binary objects in the databaseTim Laszlo2010-07-081-4/+10
| | | | git-svn-id: https://svn.mcs.anl.gov/repos/bcfg/trunk/bcfg2@5962 ce84e21b-d406-0410-9b95-82705330c041
* Switch location to hostname. Urls break things.Tim Laszlo2010-06-041-6/+2
| | | | git-svn-id: https://svn.mcs.anl.gov/repos/bcfg/trunk/bcfg2@5887 ce84e21b-d406-0410-9b95-82705330c041
* Performance updates to dynamic reportsTim Laszlo2010-06-031-0/+8
| | | | | | | | | | | | | | | | | Added bad_entries, modified_entries, extra_entries database fields to reduce the number of calls. Created (bad|modified|extra)_entry_count methods to return the sbove fields and populate any missing values. Consolidate interaction_per_client query. Added unique constraint on client_id and timestamp in Interaction. Greatly improved the performance of interaction_per_client. Modified detailed-list.html to add modified field and reduce the database calls to two... unless the bad_entries, modified_entries, extra_entries fields need updating. Modified client index to use only two database queries. Adding automatic update Updating load_stats to update counters in reports_interaction git-svn-id: https://svn.mcs.anl.gov/repos/bcfg/trunk/bcfg2@5885 ce84e21b-d406-0410-9b95-82705330c041
* Add option to log importscript.py messages to syslogTim Laszlo2010-05-261-9/+13
| | | | | | | Since we need the ability to do this for DBStats.py it doesn't hurt to add this if importscript.py runs with statistics.xml data. git-svn-id: https://svn.mcs.anl.gov/repos/bcfg/trunk/bcfg2@5868 ce84e21b-d406-0410-9b95-82705330c041
* Use logging instead of print statements in importscript.pyTim Laszlo2010-05-261-13/+21
| | | | | | | | Switch from print statements to the standard Logger.py functions. This allows load_stats in importscript.py to log error messages when daemonized. git-svn-id: https://svn.mcs.anl.gov/repos/bcfg/trunk/bcfg2@5867 ce84e21b-d406-0410-9b95-82705330c041
* DBStats: Handle errors in load_statsTim Laszlo2010-05-261-8/+14
| | | | | | | | If any of the sql database insertsor selects failed, the all of the data for the client at that point was lost. This uses an empty Reason object to preserve the rest of the data. git-svn-id: https://svn.mcs.anl.gov/repos/bcfg/trunk/bcfg2@5866 ce84e21b-d406-0410-9b95-82705330c041
* importscript.py: Add support for -C option (Patch from euth in Ticket #852)Sol Jerome2010-03-071-1/+1
| | | | | | Signed-off-by: Sol Jerome <solj@ices.utexas.edu> git-svn-id: https://svn.mcs.anl.gov/repos/bcfg/trunk/bcfg2@5756 ce84e21b-d406-0410-9b95-82705330c041
* Revert accidental svn keyword changes and add minor pylint fixesSol Jerome2009-01-151-1/+1
| | | | git-svn-id: https://svn.mcs.anl.gov/repos/bcfg/trunk/bcfg2@5027 ce84e21b-d406-0410-9b95-82705330c041
* Add support for alternate VCS backendsSol Jerome2009-01-131-8/+8
| | | | git-svn-id: https://svn.mcs.anl.gov/repos/bcfg/trunk/bcfg2@5023 ce84e21b-d406-0410-9b95-82705330c041
* Update dictionary accesses to work with Python 3.0Sol Jerome2008-12-221-1/+1
| | | | git-svn-id: https://svn.mcs.anl.gov/repos/bcfg/trunk/bcfg2@4999 ce84e21b-d406-0410-9b95-82705330c041
* Improve importscript error messages (Patch from Kamil Kiseil)Narayan Desai2008-11-041-2/+2
| | | | git-svn-id: https://svn.mcs.anl.gov/repos/bcfg/trunk/bcfg2@4961 ce84e21b-d406-0410-9b95-82705330c041
* Add reporting system schema evolution support (from Stousignant)Narayan Desai2008-08-201-34/+36
| | | | git-svn-id: https://svn.mcs.anl.gov/repos/bcfg/trunk/bcfg2@4884 ce84e21b-d406-0410-9b95-82705330c041
* Improve robustness of the importerNarayan Desai2008-08-191-2/+8
| | | | git-svn-id: https://svn.mcs.anl.gov/repos/bcfg/trunk/bcfg2@4882 ce84e21b-d406-0410-9b95-82705330c041
* Switch dbstats to using fast reports importerNarayan Desai2008-08-061-5/+6
| | | | git-svn-id: https://svn.mcs.anl.gov/repos/bcfg/trunk/bcfg2@4858 ce84e21b-d406-0410-9b95-82705330c041
* Add new DBstats plugin (direct to reports db)Narayan Desai2008-07-221-2/+0
| | | | git-svn-id: https://svn.mcs.anl.gov/repos/bcfg/trunk/bcfg2@4820 ce84e21b-d406-0410-9b95-82705330c041
* Get importscript properly function-ifiedNarayan Desai2008-07-221-93/+87
| | | | git-svn-id: https://svn.mcs.anl.gov/repos/bcfg/trunk/bcfg2@4819 ce84e21b-d406-0410-9b95-82705330c041
* Add -O3 mode to importscript to relax reason deduplication process (Results ↵Narayan Desai2008-05-301-6/+18
| | | | | | in 1000X speedup for large databases) Because it breaks common reason display in the reporting system, this is non-default behavior git-svn-id: https://svn.mcs.anl.gov/repos/bcfg/trunk/bcfg2@4639 ce84e21b-d406-0410-9b95-82705330c041
* Fix reports system settings importNarayan Desai2008-05-021-1/+1
| | | | git-svn-id: https://svn.mcs.anl.gov/repos/bcfg/trunk/bcfg2@4588 ce84e21b-d406-0410-9b95-82705330c041
* Improve importscript error message when bcfg2.conf is not readable (Resolves ↵Narayan Desai2008-03-091-7/+4
| | | | | | Ticket #527) [bugfix] git-svn-id: https://svn.mcs.anl.gov/repos/bcfg/trunk/bcfg2@4411 ce84e21b-d406-0410-9b95-82705330c041
* Revert bad error messages in importscriptNarayan Desai2007-11-051-2/+0
| | | | git-svn-id: https://svn.mcs.anl.gov/repos/bcfg/trunk/bcfg2@3912 ce84e21b-d406-0410-9b95-82705330c041
* Fix reports traceback with mysql (Resolves Ticket #487)Narayan Desai2007-10-301-1/+1
| | | | git-svn-id: https://svn.mcs.anl.gov/repos/bcfg/trunk/bcfg2@3884 ce84e21b-d406-0410-9b95-82705330c041
* print errors when they occurNarayan Desai2007-10-291-0/+2
| | | | git-svn-id: https://svn.mcs.anl.gov/repos/bcfg/trunk/bcfg2@3878 ce84e21b-d406-0410-9b95-82705330c041
* Fix refactor importscript breakage and add optparsing patch from TimLNarayan Desai2007-10-261-35/+45
| | | | git-svn-id: https://svn.mcs.anl.gov/repos/bcfg/trunk/bcfg2@3871 ce84e21b-d406-0410-9b95-82705330c041
* Make importscript even more efficientNarayan Desai2007-10-111-12/+1
| | | | git-svn-id: https://svn.mcs.anl.gov/repos/bcfg/trunk/bcfg2@3795 ce84e21b-d406-0410-9b95-82705330c041
* Add sparse client updates (should speed up runs with big databases _a lot_)Narayan Desai2007-10-111-22/+25
| | | | git-svn-id: https://svn.mcs.anl.gov/repos/bcfg/trunk/bcfg2@3792 ce84e21b-d406-0410-9b95-82705330c041
* switch last data hashes over to django objectsNarayan Desai2007-10-111-29/+25
| | | | git-svn-id: https://svn.mcs.anl.gov/repos/bcfg/trunk/bcfg2@3788 ce84e21b-d406-0410-9b95-82705330c041
* Continue changes to use django datatypes (further reduces resource consumption)Narayan Desai2007-10-101-40/+30
| | | | git-svn-id: https://svn.mcs.anl.gov/repos/bcfg/trunk/bcfg2@3787 ce84e21b-d406-0410-9b95-82705330c041
* Fix importscript.py performance problemsNarayan Desai2007-10-101-45/+38
| | | | git-svn-id: https://svn.mcs.anl.gov/repos/bcfg/trunk/bcfg2@3786 ce84e21b-d406-0410-9b95-82705330c041
* fix base64 problemNarayan Desai2007-07-161-2/+2
| | | | git-svn-id: https://svn.mcs.anl.gov/repos/bcfg/trunk/bcfg2@3453 ce84e21b-d406-0410-9b95-82705330c041
* Add checker support to ComponentNarayan Desai2007-07-131-3/+12
| | | | git-svn-id: https://svn.mcs.anl.gov/repos/bcfg/trunk/bcfg2@3441 ce84e21b-d406-0410-9b95-82705330c041
* Moved the new reporting system in to Server module.Joey Hagedorn2006-11-221-3/+3
| | | | git-svn-id: https://svn.mcs.anl.gov/repos/bcfg/trunk/bcfg2@2525 ce84e21b-d406-0410-9b95-82705330c041
* finishing moveJoey Hagedorn2006-11-221-0/+285
git-svn-id: https://svn.mcs.anl.gov/repos/bcfg/trunk/bcfg2@2521 ce84e21b-d406-0410-9b95-82705330c041
generated by cgit v1.2.3-1-g7c22 (git 2.25.1) at 2024-10-30 15:16:32 +0000