Human Generated Data

Title

Labor Demonstration at Madison Square Garden, from left to right: Mrs. Anna Rosenberg, Joseph Ryan, William Green (1873-1952), Sidney Hillman (1887-1946), and John Llewellyn Lewis (1880-1969)
Date

1931
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Dr. Daniel Bell, P1979.47

Human Generated Data

Title

Labor Demonstration at Madison Square Garden, from left to right: Mrs. Anna Rosenberg, Joseph Ryan, William Green (1873-1952), Sidney Hillman (1887-1946), and John Llewellyn Lewis (1880-1969)

People

Artist: Unidentified Artist,

Date

1931

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Dr. Daniel Bell, P1979.47

Machine Generated Data

Tags

Amazon
created on 2022-06-03

Person 99.3
Human 99.3
Person 99.1
Person 99
Person 99
Person 98.1
Tie 95.9
Accessories 95.9
Accessory 95.9
Footwear 92.2
Apparel 92.2
Shoe 92.2
Clothing 92.2
People 91.6
Chair 89.5
Furniture 89.5
Shoe 89.3
Crowd 88.9
Military 87.3
Military Uniform 87.3
Tie 85.9
Audience 71
Person 68.3
Officer 66.2
Army 60.1
Armored 60.1
Soldier 58.4
Room 55.8
Indoors 55.8
Shoe 53

Clarifai
created on 2023-10-30

people 100
group 99.5
group together 99.3
many 98.9
uniform 97.6
military 95.9
leader 95.9
adult 95
military uniform 94.9
outfit 93.7
man 93.7
wear 93
administration 92.2
soldier 91.5
several 91.4
child 90.3
war 87.8
chair 84.3
woman 84
sit 76.1

Imagga
created on 2022-06-03

kin 50
people 24
person 22.3
man 21.5
adult 15.9
male 14.9
athlete 13.6
portrait 13.6
silhouette 13.2
brass 12.8
statue 12.4
wind instrument 12.1
group 12.1
mask 12
player 11.8
world 11.7
musical instrument 11.7
dark 11.7
ballplayer 11.6
outdoor 11.5
sport 10.8
art 10.8
couple 10.4
men 10.3
culture 10.2
black 10.2
contestant 10
protection 10
dirty 9.9
history 9.8
soldier 9.8
sculpture 9.7
clothing 9.5
travel 9.1
girls 9.1
danger 9.1
dress 9
child 9
sunset 9
dance 8.9
military 8.7
boy 8.7
love 8.7
play 8.6
walking 8.5
old 8.4
holding 8.2
human 8.2
fun 8.2
industrial 8.2
family 8
women 7.9
radioactive 7.8
radiation 7.8
toxic 7.8
protective 7.8
uniform 7.8
nuclear 7.8
chemical 7.7
run 7.7
summer 7.7
gas 7.7
youth 7.7
fashion 7.5
happy 7.5
friendship 7.5
traditional 7.5
style 7.4
park 7.4
tradition 7.4
street 7.4
active 7.2
happiness 7
together 7

Google
created on 2022-06-03

Footwear 98.4
Trousers 96.3
Headgear 82.5
Crew 78.3
Vintage clothing 74.5
Event 73.1
Team 72.8
Monochrome 71.8
Sitting 69.5
History 66.1
Suit 64.8
Boot 63.9
Monochrome photography 63.7
Stock photography 63.1
Chair 62.7
Lap 59.7
Room 57.2
Uniform 54.3
Family 51.5

Microsoft
created on 2022-06-03

person 100
clothing 98.7
old 96.8
man 96.3
posing 92.9
group 89.7
black 87.9
footwear 86.2
text 74.9
people 74.5
player 70.8
photograph 66.7
smile 50.5
vintage 42.6

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 42-50
Gender Male, 98.5%
Calm 96.4%
Surprised 6.8%
Fear 5.9%
Sad 2.2%
Angry 1.6%
Confused 0.5%
Disgusted 0.1%
Happy 0%

AWS Rekognition

Age 37-45
Gender Male, 100%
Calm 73.5%
Surprised 9.1%
Confused 7.8%
Fear 7.2%
Sad 6.9%
Angry 1.4%
Disgusted 0.6%
Happy 0.2%

AWS Rekognition

Age 52-60
Gender Male, 100%
Calm 76.8%
Surprised 21.1%
Fear 6.5%
Confused 2.7%
Sad 2.3%
Angry 1.6%
Disgusted 0.7%
Happy 0.2%

AWS Rekognition

Age 36-44
Gender Female, 100%
Surprised 95.8%
Calm 21%
Confused 9.4%
Fear 6.3%
Sad 2.2%
Angry 0.3%
Happy 0.2%
Disgusted 0.2%

AWS Rekognition

Age 45-53
Gender Male, 96%
Calm 96.1%
Surprised 7.2%
Fear 6%
Sad 2.2%
Confused 1.4%
Angry 0.1%
Disgusted 0.1%
Happy 0.1%

AWS Rekognition

Age 57-65
Gender Male, 98.3%
Calm 99.8%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Confused 0%
Angry 0%
Happy 0%
Disgusted 0%

AWS Rekognition

Age 48-56
Gender Male, 86.6%
Calm 49.1%
Confused 41%
Surprised 7.7%
Fear 6.1%
Angry 3.4%
Sad 2.6%
Disgusted 1.2%
Happy 0.6%

Microsoft Cognitive Services

Age 48
Gender Male

Microsoft Cognitive Services

Age 59
Gender Male

Microsoft Cognitive Services

Age 35
Gender Male

Microsoft Cognitive Services

Age 27
Gender Female

Microsoft Cognitive Services

Age 68
Gender Male

Microsoft Cognitive Services

Age 45
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Feature analysis

Amazon

Person 99.3%
Tie 95.9%
Shoe 92.2%
Chair 89.5%

Categories

Imagga

people portraits 99.3%

Text analysis

Amazon

WIREPHOTO
AP

Google

WIREPHOTO
11 WIREPHOTO
11