Commit Graph

658 Commits

Author SHA1 Message Date
Glenn Jocher a066a7b8ea updates 2019-12-06 19:05:51 -08:00
Glenn Jocher 63c2736c12 updates 2019-12-04 23:02:32 -08:00
Glenn Jocher 0a04eb9ff1 updates 2019-12-04 15:15:42 -08:00
Glenn Jocher a2dc8a6b5a updates 2019-12-04 15:15:23 -08:00
Glenn Jocher 93a70d958a updates 2019-12-02 11:31:19 -08:00
Glenn Jocher 3d91731519 updates 2019-12-01 14:07:09 -08:00
Glenn Jocher e637ae44dd updates 2019-12-01 14:06:11 -08:00
Glenn Jocher d6a7a614dc updates 2019-12-01 13:51:55 -08:00
Glenn Jocher 92690302bb updates 2019-12-01 13:49:38 -08:00
Glenn Jocher e613bbc88c updates 2019-11-29 19:10:01 -08:00
Glenn Jocher 9e9a6a1425 updates 2019-11-27 15:50:29 -10:00
Glenn Jocher 82b62c9855 updates 2019-11-27 15:50:00 -10:00
Glenn Jocher 3c57ff7b1b updates 2019-11-25 17:24:05 -10:00
Glenn Jocher 75e8ec323f updates 2019-11-25 11:45:28 -10:00
Francisco Reveriano 26e3a28bee Update train.py for distributive programming (#655)
When attempting to running this function in a multi-GPU environment I kept on getting a runtime issue. I was able to solve this problem by passing this keyword. I first found the solution here: 
https://github.com/pytorch/pytorch/issues/22436
and in the pytorch tutorial

'RuntimeError: Expected to have finished reduction in the prior iteration before starting a new one. This error indicates that your module has parameters that were not used in producing loss. You can enable unused parameter detection by (1) passing the keyword argument find_unused_parameters=True to torch.nn.parallel.DistributedDataParallel; (2) making sure all forward function outputs participate in calculating loss. If you already have done the above two steps, then the distributed data parallel module wasn't able to locate the output tensors in the return value of your module's forward function. Please include the loss function and the structure of the return value of forward of your module when reporting this issue (e.g. list, dict, iterable). '
2019-11-24 22:21:36 -10:00
Glenn Jocher 7773651e8e updates 2019-11-24 18:38:30 -10:00
Glenn Jocher f12a2a513a updates 2019-11-24 18:29:29 -10:00
Glenn Jocher f38723c0bd updates 2019-11-20 19:34:22 -08:00
Glenn Jocher 3a4ed8b3ab updates 2019-11-20 13:40:24 -08:00
Glenn Jocher bb209111c4 updates 2019-11-20 13:36:15 -08:00
Glenn Jocher 8e327e3bd0 updates 2019-11-20 13:33:25 -08:00
Glenn Jocher 2950f4c816 updates 2019-11-20 13:26:50 -08:00
Glenn Jocher c14ea59c71 updates 2019-11-20 13:24:50 -08:00
Glenn Jocher bd498ae776 updates 2019-11-20 13:14:24 -08:00
Glenn Jocher e58f0a68b6 updates 2019-11-20 12:05:40 -08:00
Glenn Jocher d355e539d9 updates 2019-11-19 18:47:22 -08:00
Glenn Jocher d9805d2fb6 updates 2019-11-19 12:42:12 -08:00
Glenn Jocher 2ba1a4c9cc updates 2019-11-18 12:01:17 -08:00
Glenn Jocher 9c716a39c3 updates 2019-11-17 19:00:12 -08:00
Glenn Jocher a1151c04a7 updates 2019-11-17 18:48:50 -08:00
Glenn Jocher fe9ade6a64 updates 2019-11-16 12:07:19 -08:00
Glenn Jocher 985006a52a updates 2019-11-14 17:25:29 -08:00
Glenn Jocher 9daa5e858a updates 2019-11-14 17:22:09 -08:00
Glenn Jocher fedc2150b3 updates 2019-11-14 17:12:55 -08:00
Glenn Jocher 6047be35cf updates 2019-11-14 15:08:58 -08:00
Glenn Jocher a96e010251 updates 2019-11-14 15:07:27 -08:00
Glenn Jocher 579fdc57f8 updates 2019-11-09 10:56:38 -08:00
Glenn Jocher 97ac36ec6c updates 2019-11-08 10:19:46 -08:00
Glenn Jocher d0e000b008 updates 2019-11-07 20:11:03 -08:00
Glenn Jocher 09ca721f88 updates 2019-11-06 10:10:53 -08:00
Glenn Jocher f7f8bb23c2 updates 2019-11-04 16:34:45 -08:00
Glenn Jocher fd3f2ed65f updates 2019-11-02 19:54:14 -07:00
Glenn Jocher 3ba7fc69b8 updates 2019-11-02 19:47:25 -07:00
Glenn Jocher 8d1ab548c1 updates 2019-10-25 11:04:10 -05:00
Glenn Jocher b3b4ff4107 updates 2019-10-25 11:03:33 -05:00
Glenn Jocher d957b20a53 updates 2019-10-25 11:03:04 -05:00
Glenn Jocher d1271941ad updates 2019-10-16 01:40:40 +02:00
Glenn Jocher d23ada04dc updates 2019-10-16 01:36:13 +02:00
Glenn Jocher 376e00a3cf updates 2019-10-13 18:53:15 +02:00
Glenn Jocher 725762b937 updates 2019-10-13 17:41:49 +02:00
Glenn Jocher 2f46e7d765 updates 2019-10-13 17:40:45 +02:00
Glenn Jocher 0985dc91d5 updates 2019-10-13 13:11:40 +02:00
Glenn Jocher 8397fa7a2a updates 2019-10-12 13:03:57 +02:00
Glenn Jocher a4e9aa34ef updates 2019-10-09 00:14:27 +02:00
Glenn Jocher 1e3480d76c updates 2019-10-08 23:22:41 +02:00
Glenn Jocher 69745d8b8e updates 2019-10-08 14:08:23 +02:00
Glenn Jocher 88ba61505f updates 2019-10-08 13:30:21 +02:00
Glenn Jocher 2e0303d44c updates 2019-10-07 00:51:10 +02:00
Glenn Jocher 1a8bbf600d updates 2019-10-07 00:50:47 +02:00
Glenn Jocher 8c7a8ffecb updates 2019-10-05 15:29:27 +02:00
Glenn Jocher b6d9a742ec updates 2019-10-05 15:28:02 +02:00
Glenn Jocher 8610026e2c updates 2019-10-05 12:45:10 +02:00
Glenn Jocher f146692ad0 updates 2019-09-26 12:58:26 +02:00
Glenn Jocher 2487b0694f updates 2019-09-26 12:08:40 +02:00
Glenn Jocher 3072d72375 updates 2019-09-26 12:06:26 +02:00
Glenn Jocher 33e025838f updates 2019-09-26 03:30:31 +02:00
Glenn Jocher db49211d70 updates 2019-09-20 20:31:37 +02:00
Glenn Jocher de0612ca09 updates 2019-09-19 18:08:21 +02:00
Glenn Jocher c24702941f updates 2019-09-19 18:05:04 +02:00
Glenn Jocher 6d8e82c175 updates 2019-09-19 02:10:55 +02:00
Glenn Jocher 975b657262 updates 2019-09-19 00:36:11 +02:00
Glenn Jocher 80d71fa883 updates 2019-09-18 13:23:37 +02:00
Glenn Jocher 1f2e60ff43 updates 2019-09-18 02:25:09 +02:00
Glenn Jocher e9437b2178 updates 2019-09-18 00:54:07 +02:00
Glenn Jocher fff60c651a updates 2019-09-18 00:38:49 +02:00
Glenn Jocher 78bb153d7d updates 2019-09-17 15:16:29 +02:00
Glenn Jocher 87d2e51f0d updates 2019-09-16 20:05:54 +02:00
Glenn Jocher 78e9bf60d2 updates 2019-09-16 19:53:44 +02:00
Glenn Jocher efe86b0c4c updates 2019-09-16 19:49:09 +02:00
Glenn Jocher 4286bba40f updates 2019-09-13 16:00:52 +02:00
Glenn Jocher 780fa17f6a updates 2019-09-12 11:14:59 +02:00
Glenn Jocher fb81559565 updates 2019-09-11 23:11:01 +02:00
Glenn Jocher 7997be8bba updates 2019-09-11 23:04:48 +02:00
Glenn Jocher 17cf9f4a07 updates 2019-09-11 22:21:39 +02:00
Glenn Jocher a1b50aaa43 updates 2019-09-11 21:24:22 +02:00
Glenn Jocher 806d7b92d8 updates 2019-09-11 14:25:48 +02:00
Glenn Jocher 270724e507 updates 2019-09-11 14:03:23 +02:00
Glenn Jocher 3f7f2c4a13 updates 2019-09-11 14:00:57 +02:00
Glenn Jocher 919aff828e updates 2019-09-11 13:15:16 +02:00
Glenn Jocher 2a75034322 updates 2019-09-10 17:28:36 +02:00
Glenn Jocher f20a03e28e updates 2019-09-10 14:59:45 +02:00
Glenn Jocher a2016201f3 updates 2019-09-10 14:04:16 +02:00
Glenn Jocher c1ad7e6c2b updates 2019-09-10 11:35:46 +02:00
Glenn Jocher 4445715f4c updates 2019-09-09 22:42:38 +02:00
Glenn Jocher 94234c80b2 updates
Signed-off-by: Glenn Jocher <glenn.jocher@ultralytics.com>
2019-09-04 14:58:18 +02:00
Glenn Jocher 6cd98c46d8 updates
Signed-off-by: Glenn Jocher <glenn.jocher@ultralytics.com>
2019-09-04 09:20:03 +02:00
Glenn Jocher 447292eb36 updates
Signed-off-by: Glenn Jocher <glenn.jocher@ultralytics.com>
2019-09-03 16:20:55 +02:00
Glenn Jocher 2877ac9286 updates
Signed-off-by: Glenn Jocher <glenn.jocher@ultralytics.com>
2019-09-02 14:28:13 +02:00
Glenn Jocher ea61b46b31 updates
Signed-off-by: Glenn Jocher <glenn.jocher@ultralytics.com>
2019-09-02 14:02:08 +02:00
Glenn Jocher 8f913ba82a updates
Signed-off-by: Glenn Jocher <glenn.jocher@ultralytics.com>
2019-09-02 11:59:13 +02:00