Human Generated Data

Title

Untitled (Greek priest and group of men posed together at podium outdoors)

Date

1950

People

Artist: Martin Schweig, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9322

Human Generated Data

Title

Untitled (Greek priest and group of men posed together at podium outdoors)

People

Artist: Martin Schweig, American 20th century

Date

1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Person 99.2
Human 99.2
Person 98.7
Person 98.1
Person 96.5
Person 96.3
Person 95.5
Person 94.8
Person 94.8
Person 94.6
Person 94.3
Person 92.2
Crowd 80.9
Clothing 78.1
Apparel 78.1
Person 75.8
People 66.8
Sailor Suit 64.4
Officer 57.5
Military 57.5
Military Uniform 57.5
Priest 56.2
Person 54.7

Imagga
created on 2022-01-23

musical instrument 32.5
man 20.1
person 20
wind instrument 19.5
people 19
brass 18.2
male 17
marimba 16.2
adult 16
metropolitan 15.2
percussion instrument 15.1
clothing 13.8
old 13.2
black 13.2
violin 13.1
men 12.9
cornet 12.3
bowed stringed instrument 12
stringed instrument 11.6
business 11.5
businessman 11.5
couple 11.3
professional 11
architecture 10.9
women 10.3
group 9.7
scene 9.5
building 9.5
world 9.3
art 9.2
portrait 9.1
history 8.9
chemical 8.7
happiness 8.6
outfit 8.5
trombone 8.5
travel 8.4
kin 8.4
color 8.3
symbol 8.1
religion 8.1
light 8
night 8
uniform 7.8
dark 7.5
city 7.5
silhouette 7.4
suit 7.3
window 7.3
dress 7.2
dirty 7.2
worker 7.2
life 7.1
family 7.1
love 7.1
day 7.1
medical 7.1

Google
created on 2022-01-23

Microsoft
created on 2022-01-23

text 81.2
wedding dress 68.9
black 67.6
clothing 66.6
white 61.9
person 61.2
black and white 55.2

Face analysis

Amazon

Google

AWS Rekognition

Age 36-44
Gender Female, 96.4%
Calm 91.9%
Surprised 7.2%
Confused 0.5%
Disgusted 0.2%
Sad 0.1%
Happy 0.1%
Fear 0%
Angry 0%

AWS Rekognition

Age 33-41
Gender Male, 91.4%
Calm 87.4%
Happy 11.2%
Surprised 0.4%
Sad 0.4%
Confused 0.2%
Disgusted 0.1%
Fear 0.1%
Angry 0.1%

AWS Rekognition

Age 43-51
Gender Male, 94.4%
Calm 96.9%
Sad 2.1%
Happy 0.5%
Surprised 0.2%
Confused 0.1%
Disgusted 0.1%
Angry 0.1%
Fear 0%

AWS Rekognition

Age 18-24
Gender Female, 89.2%
Calm 99.9%
Happy 0.1%
Surprised 0%
Disgusted 0%
Confused 0%
Sad 0%
Angry 0%
Fear 0%

AWS Rekognition

Age 45-53
Gender Male, 99.3%
Calm 97.7%
Sad 1.1%
Confused 0.6%
Happy 0.2%
Surprised 0.1%
Fear 0.1%
Angry 0.1%
Disgusted 0.1%

AWS Rekognition

Age 38-46
Gender Female, 91.5%
Calm 86.1%
Sad 6.4%
Happy 2.4%
Surprised 1.4%
Confused 1.3%
Angry 1.3%
Fear 0.8%
Disgusted 0.5%

AWS Rekognition

Age 35-43
Gender Male, 99.7%
Calm 74.9%
Fear 10.9%
Sad 3.6%
Surprised 3.3%
Angry 3.2%
Happy 1.7%
Disgusted 1.4%
Confused 1%

AWS Rekognition

Age 37-45
Gender Female, 64.4%
Calm 97.6%
Happy 1.1%
Confused 0.5%
Sad 0.3%
Angry 0.2%
Surprised 0.1%
Fear 0.1%
Disgusted 0.1%

AWS Rekognition

Age 29-39
Gender Female, 50.4%
Happy 88.1%
Calm 2.8%
Fear 2.3%
Disgusted 1.8%
Angry 1.7%
Surprised 1.5%
Confused 1.3%
Sad 0.6%

AWS Rekognition

Age 2-8
Gender Male, 94.9%
Calm 72.9%
Surprised 25%
Confused 0.8%
Fear 0.4%
Angry 0.4%
Disgusted 0.3%
Sad 0.1%
Happy 0.1%

AWS Rekognition

Age 25-35
Gender Male, 98.1%
Calm 46%
Fear 43.8%
Surprised 4.4%
Sad 4%
Disgusted 0.8%
Confused 0.5%
Angry 0.3%
Happy 0.2%

AWS Rekognition

Age 58-66
Gender Male, 63.4%
Calm 98.6%
Sad 0.8%
Angry 0.2%
Happy 0.1%
Disgusted 0.1%
Surprised 0.1%
Confused 0.1%
Fear 0.1%

AWS Rekognition

Age 48-54
Gender Male, 80.2%
Happy 60.7%
Fear 20.4%
Calm 12.2%
Surprised 3.2%
Sad 1.9%
Disgusted 0.6%
Confused 0.6%
Angry 0.3%

AWS Rekognition

Age 1-7
Gender Female, 79.3%
Sad 53.5%
Calm 30.6%
Disgusted 5.7%
Angry 4.9%
Fear 3.6%
Happy 0.8%
Confused 0.6%
Surprised 0.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%

Captions

Microsoft

a group of people standing in front of a building 89.6%
a group of people in front of a building 88.8%
a group of people that are standing in front of a building 83.2%

Text analysis

Amazon

FORESTER
URS
MAAS
OLD FORESTER
URS MAAS STEFFEN CO-FUR
STEFFEN
SC
OLD
-
CO-FUR
- -
YT37A-

Google

OD FORESTER RURS HAANTEEFEN CA FUR
HAANTEEFEN
CA
RURS
OD
FUR
FORESTER