Human Generated Data

Title

Bus Driver Listening at Strike Meeting, St. Nicholas Arena

Date

1948

People

Artist: Morris Engel, American 1918 - 2005

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Dr. Daniel Bell, P1979.57

Human Generated Data

Title

Bus Driver Listening at Strike Meeting, St. Nicholas Arena

People

Artist: Morris Engel, American 1918 - 2005

Date

1948

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Human 100
Audience 100
Crowd 100
Person 99.3
Person 99.3
Person 98.7
Person 96.9
Person 96.2
Person 96.1
Person 92.6
Sunglasses 91.4
Accessory 91.4
Accessories 91.4
Sunglasses 89.4
Sunglasses 82.5
Face 69
Clothing 68.6
Overcoat 68.6
Coat 68.6
Suit 68.6
Apparel 68.6
Person 65
Head 60.4
Speech 55.6

Imagga
created on 2021-12-14

person 36.7
man 34.9
male 31.9
people 30.7
black 20.7
portrait 20.7
business 18.2
spectator 18.1
face 17.7
dark 17.5
adult 17.3
men 15.4
silhouette 14.9
executive 14.3
businessman 14.1
photographer 13.8
suit 13.6
handsome 13.4
world 13
group 12.1
corporate 12
happy 11.3
human 11.2
old 11.1
night 10.6
couple 10.4
expression 10.2
light 10
hand 9.9
jacket 9.6
tie 9.5
office 9.1
one 9
professional 8.8
lifestyle 8.7
smile 8.5
clothing 8.5
planner 8.2
success 8
dance 8
looking 8
love 7.9
evil 7.8
casual 7.6
shirt 7.6
senior 7.5
vintage 7.4
style 7.4
glasses 7.4
performer 7.3
indoor 7.3
music 7.3
dress 7.2
religion 7.2

Google
created on 2021-12-14

Eyewear 85.2
Style 83.8
Black-and-white 82.9
Font 73.5
Suit 73.4
Monochrome photography 72.9
Event 72.8
Monochrome 71.5
Crowd 70.2
Smile 68.1
Stock photography 62.6
Room 61.7
History 61.5
Vintage clothing 54.6
Crew 53.4
Team 51.6

Microsoft
created on 2021-12-14

clothing 98.6
human face 98.4
man 97.4
person 97
text 95.5
smile 85.2
posing 71.2
group 64.9
black and white 56.3
image 32.6
crowd 24
picture frame 7.8

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 22-34
Gender Male, 96.2%
Calm 89.8%
Surprised 3.5%
Angry 3.3%
Disgusted 1.4%
Confused 0.8%
Sad 0.5%
Happy 0.5%
Fear 0.3%

AWS Rekognition

Age 32-48
Gender Male, 99.7%
Calm 88.1%
Confused 4.9%
Sad 4.6%
Angry 1.1%
Happy 0.6%
Surprised 0.4%
Disgusted 0.2%
Fear 0.2%

AWS Rekognition

Age 22-34
Gender Male, 99.6%
Calm 94.5%
Angry 1.5%
Surprised 1.3%
Happy 1.3%
Confused 0.7%
Sad 0.5%
Disgusted 0.1%
Fear 0.1%

AWS Rekognition

Age 23-35
Gender Male, 95%
Calm 95.6%
Sad 2%
Confused 1.2%
Happy 0.4%
Angry 0.3%
Surprised 0.3%
Disgusted 0.1%
Fear 0.1%

AWS Rekognition

Age 23-35
Gender Male, 99%
Angry 33%
Sad 28.7%
Calm 26.1%
Fear 5.1%
Confused 4.4%
Surprised 1.9%
Disgusted 0.6%
Happy 0.2%

AWS Rekognition

Age 22-34
Gender Male, 93.1%
Calm 89.3%
Confused 4.2%
Surprised 2.8%
Happy 1.5%
Sad 1.3%
Angry 0.5%
Disgusted 0.4%
Fear 0.2%

AWS Rekognition

Age 31-47
Gender Female, 91.7%
Calm 26.9%
Disgusted 26.3%
Fear 14.7%
Surprised 13.4%
Confused 7.3%
Sad 4.9%
Angry 4.2%
Happy 2.4%

AWS Rekognition

Age 17-29
Gender Female, 57.5%
Calm 30.1%
Sad 27.5%
Confused 20.6%
Surprised 10%
Fear 4.3%
Happy 3.9%
Disgusted 1.8%
Angry 1.7%

AWS Rekognition

Age 43-61
Gender Male, 93.6%
Angry 52.2%
Sad 16.6%
Calm 16%
Fear 6.2%
Surprised 3.3%
Disgusted 3.1%
Confused 2%
Happy 0.6%

AWS Rekognition

Age 27-43
Gender Male, 91.1%
Calm 69.2%
Sad 18.9%
Happy 4.2%
Fear 2.8%
Angry 2%
Surprised 1.4%
Confused 1.2%
Disgusted 0.3%

AWS Rekognition

Age 33-49
Gender Male, 99.6%
Sad 54%
Calm 25.6%
Fear 13.2%
Confused 2.3%
Angry 2.1%
Happy 1.5%
Surprised 0.7%
Disgusted 0.6%

AWS Rekognition

Age 32-48
Gender Male, 58.6%
Calm 88%
Happy 4.6%
Sad 3.2%
Confused 1.1%
Angry 1%
Surprised 1%
Disgusted 0.7%
Fear 0.4%

AWS Rekognition

Age 34-50
Gender Male, 98.1%
Happy 62%
Calm 35.7%
Surprised 0.5%
Sad 0.5%
Disgusted 0.5%
Angry 0.4%
Confused 0.3%
Fear 0.1%

AWS Rekognition

Age 22-34
Gender Male, 98.4%
Calm 57.5%
Angry 19.1%
Happy 8.5%
Sad 7.2%
Fear 4.6%
Confused 1.7%
Surprised 0.9%
Disgusted 0.6%

AWS Rekognition

Age 38-56
Gender Female, 53.5%
Calm 28.7%
Fear 25.1%
Sad 24.9%
Surprised 7.1%
Confused 6.2%
Happy 3.4%
Angry 2.7%
Disgusted 2%

AWS Rekognition

Age 22-34
Gender Female, 80.5%
Happy 53.3%
Calm 31.4%
Fear 3.8%
Surprised 3.5%
Angry 2.9%
Sad 2.6%
Confused 1.4%
Disgusted 1.1%

AWS Rekognition

Age 24-38
Gender Female, 76.8%
Surprised 46.6%
Calm 39%
Happy 7.7%
Fear 1.9%
Confused 1.5%
Disgusted 1.2%
Sad 1.2%
Angry 0.9%

AWS Rekognition

Age 14-26
Gender Male, 95.9%
Calm 93.8%
Happy 4.5%
Sad 0.5%
Angry 0.3%
Surprised 0.3%
Confused 0.2%
Fear 0.2%
Disgusted 0.2%

AWS Rekognition

Age 22-34
Gender Male, 60.7%
Happy 49%
Sad 28%
Calm 17.3%
Angry 1.5%
Fear 1.2%
Confused 1.1%
Disgusted 1%
Surprised 0.8%

AWS Rekognition

Age 33-49
Gender Female, 68.8%
Calm 74.8%
Happy 12.3%
Sad 5.9%
Surprised 1.6%
Angry 1.4%
Fear 1.4%
Disgusted 1.3%
Confused 1.1%

AWS Rekognition

Age 35-51
Gender Female, 76.7%
Calm 37.3%
Happy 33.2%
Sad 11.5%
Fear 5.2%
Surprised 5.1%
Confused 3.7%
Angry 2.6%
Disgusted 1.4%

AWS Rekognition

Age 26-42
Gender Female, 57.3%
Calm 78%
Happy 11.6%
Confused 2.5%
Sad 2.1%
Surprised 1.9%
Angry 1.9%
Disgusted 1.4%
Fear 0.7%

AWS Rekognition

Age 25-39
Gender Female, 82.5%
Angry 44%
Calm 23.6%
Sad 8.2%
Happy 7%
Confused 5.9%
Surprised 4.4%
Disgusted 4.1%
Fear 2.8%

AWS Rekognition

Age 38-56
Gender Female, 70%
Sad 36.3%
Calm 31.8%
Happy 24.7%
Confused 2.4%
Angry 2.4%
Fear 1%
Surprised 0.8%
Disgusted 0.6%

AWS Rekognition

Age 24-38
Gender Male, 65%
Calm 82.6%
Sad 7.7%
Surprised 2.2%
Fear 2%
Angry 1.7%
Confused 1.6%
Disgusted 1.2%
Happy 0.9%

AWS Rekognition

Age 23-37
Gender Female, 70.8%
Calm 29.3%
Happy 27.9%
Fear 18.5%
Surprised 11.3%
Sad 4.3%
Confused 3.4%
Angry 2.8%
Disgusted 2.6%

AWS Rekognition

Age 24-38
Gender Female, 90.8%
Calm 47.9%
Happy 24.2%
Sad 10.6%
Surprised 7.4%
Fear 5.3%
Confused 2.3%
Angry 1.6%
Disgusted 0.6%

AWS Rekognition

Age 29-45
Gender Male, 72.1%
Sad 58%
Calm 40.3%
Confused 0.5%
Happy 0.3%
Angry 0.2%
Surprised 0.2%
Disgusted 0.2%
Fear 0.2%

AWS Rekognition

Age 35-51
Gender Male, 98.1%
Happy 77.6%
Calm 17.9%
Surprised 1.1%
Disgusted 1%
Angry 0.8%
Sad 0.7%
Confused 0.6%
Fear 0.3%

AWS Rekognition

Age 28-44
Gender Female, 72.6%
Calm 86%
Sad 12.9%
Happy 0.6%
Confused 0.2%
Angry 0.1%
Fear 0.1%
Surprised 0.1%
Disgusted 0%

AWS Rekognition

Age 29-45
Gender Male, 67.6%
Calm 58.4%
Sad 18.8%
Surprised 9.6%
Confused 5.9%
Fear 2.8%
Happy 2.4%
Disgusted 1.1%
Angry 1%

AWS Rekognition

Age 37-55
Gender Female, 66.4%
Calm 69.5%
Surprised 15.2%
Sad 4.7%
Angry 3.4%
Happy 2.6%
Confused 2.1%
Fear 1.6%
Disgusted 0.8%

AWS Rekognition

Age 22-34
Gender Female, 92.4%
Calm 28.3%
Angry 25.4%
Happy 13.8%
Fear 12.7%
Sad 9.1%
Confused 5.5%
Surprised 3.5%
Disgusted 1.7%

AWS Rekognition

Age 14-26
Gender Male, 88.7%
Calm 58.5%
Sad 38.9%
Angry 1.1%
Confused 0.9%
Happy 0.2%
Fear 0.2%
Surprised 0.2%
Disgusted 0.2%

AWS Rekognition

Age 32-48
Gender Female, 54%
Happy 67.5%
Calm 18.8%
Sad 9.8%
Angry 1.8%
Confused 0.7%
Surprised 0.7%
Fear 0.5%
Disgusted 0.3%

AWS Rekognition

Age 23-37
Gender Female, 89.9%
Fear 30.7%
Calm 19.3%
Sad 15.1%
Surprised 9.5%
Angry 7.1%
Happy 6.4%
Disgusted 6.2%
Confused 5.7%

AWS Rekognition

Age 20-32
Gender Male, 55.2%
Calm 51.2%
Angry 18.7%
Happy 11%
Sad 6.6%
Fear 6.3%
Surprised 2.9%
Confused 2%
Disgusted 1.3%

AWS Rekognition

Age 23-37
Gender Male, 55.5%
Calm 35.2%
Fear 19.5%
Angry 13%
Sad 9.7%
Happy 9.6%
Confused 5.7%
Surprised 5.3%
Disgusted 2.1%

Microsoft Cognitive Services

Age 57
Gender Male

Microsoft Cognitive Services

Age 36
Gender Male

Microsoft Cognitive Services

Age 44
Gender Male

Microsoft Cognitive Services

Age 30
Gender Male

Microsoft Cognitive Services

Age 50
Gender Male

Microsoft Cognitive Services

Age 52
Gender Male

Microsoft Cognitive Services

Age 30
Gender Male

Microsoft Cognitive Services

Age 42
Gender Male

Microsoft Cognitive Services

Age 29
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Feature analysis

Amazon

Person 99.3%
Sunglasses 91.4%
Suit 68.6%

Captions

Microsoft

Charles Saunders et al. standing in front of a crowd posing for the camera 94.7%
Charles Saunders et al. posing for a photo in front of a crowd 94.6%
Charles Saunders et al. in front of a crowd posing for the camera 94.5%