Human Generated Data

Title

Untitled (group portrait of fourteen women field hockey players with coach outdoors)

Date

1955

People

Artist: Martin Schweig, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9556

Human Generated Data

Title

Untitled (group portrait of fourteen women field hockey players with coach outdoors)

People

Artist: Martin Schweig, American 20th century

Date

1955

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-28

Person 99
Human 99
Person 98.7
Person 98.3
Person 97.2
Person 96.5
Person 95.5
Apparel 92.2
Clothing 92.2
Person 91.6
Person 90.3
Sport 87.5
Sports 87.5
Grass 86
Plant 86
People 84.3
Face 82.3
Person 77.4
Field 76.5
Female 72.2
Person 71.4
Ground 71.1
Person 70.7
Outdoors 70.2
Photography 69.6
Photo 69.6
Portrait 69.6
Croquet 68.8
Person 66.7
Person 65.8
Shorts 62
Person 60.6
Golf 57.9
Vegetation 57.1
Woman 56.7
Yard 56.6
Nature 56.6
Person 48.2

Imagga
created on 2022-01-28

crutch 100
staff 91.3
stick 72.6
people 22.3
man 20.8
group 17.7
walking 16.1
trombone 15
silhouette 14.9
person 13.8
brass 12.9
men 12.9
sport 12.8
outdoors 12.7
old 11.8
summer 11.6
black 11.4
male 11.3
active 10.8
adult 10.3
travel 9.8
wind instrument 9.8
landscape 9.7
life 9.4
leisure 9.1
park 9
lifestyle 8.7
water 8
together 7.9
couple 7.8
crowd 7.7
health 7.6
sun 7.2
activity 7.2
mountain 7.1
women 7.1
equipment 7.1
work 7.1

Google
created on 2022-01-28

Microsoft
created on 2022-01-28

grass 99
outdoor 97.7
posing 94.8
text 94.2
person 92.3
black 88.9
standing 80.3
old 80
white 76.6
group 76.4
grave 51.8
clothes 20.6

Face analysis

Amazon

Google

AWS Rekognition

Age 29-39
Gender Male, 92.6%
Calm 66%
Happy 18.4%
Sad 10.3%
Confused 1.7%
Disgusted 1.3%
Surprised 1.1%
Angry 0.7%
Fear 0.6%

AWS Rekognition

Age 38-46
Gender Female, 88.1%
Happy 51.3%
Calm 23%
Surprised 8.4%
Sad 7.5%
Fear 5.6%
Confused 2.5%
Disgusted 1%
Angry 0.6%

AWS Rekognition

Age 25-35
Gender Male, 90.8%
Happy 69.1%
Calm 24.6%
Sad 4.8%
Disgusted 0.3%
Fear 0.3%
Confused 0.3%
Surprised 0.3%
Angry 0.1%

AWS Rekognition

Age 27-37
Gender Male, 66.8%
Calm 43.2%
Happy 32.3%
Sad 6%
Confused 5.4%
Surprised 4.6%
Fear 3.6%
Disgusted 3.3%
Angry 1.6%

AWS Rekognition

Age 24-34
Gender Male, 68.9%
Calm 99.8%
Happy 0.1%
Confused 0.1%
Sad 0%
Surprised 0%
Disgusted 0%
Angry 0%
Fear 0%

AWS Rekognition

Age 25-35
Gender Male, 87.8%
Happy 69.2%
Sad 23.3%
Calm 3.9%
Fear 1%
Confused 1%
Disgusted 0.6%
Angry 0.6%
Surprised 0.4%

AWS Rekognition

Age 23-31
Gender Male, 53.3%
Calm 84.7%
Happy 12%
Sad 1.7%
Confused 0.8%
Surprised 0.4%
Disgusted 0.2%
Angry 0.1%
Fear 0.1%

AWS Rekognition

Age 24-34
Gender Male, 99.5%
Sad 42.2%
Calm 38.2%
Happy 10.6%
Confused 3.3%
Fear 2.1%
Surprised 1.6%
Disgusted 1.6%
Angry 0.5%

AWS Rekognition

Age 37-45
Gender Male, 63.2%
Happy 68.3%
Calm 20.3%
Confused 3.7%
Surprised 3.3%
Sad 2.2%
Disgusted 1.1%
Angry 0.6%
Fear 0.5%

AWS Rekognition

Age 42-50
Gender Female, 52.2%
Calm 99.7%
Happy 0.1%
Sad 0.1%
Confused 0%
Disgusted 0%
Angry 0%
Surprised 0%
Fear 0%

AWS Rekognition

Age 37-45
Gender Male, 91.7%
Calm 66.1%
Sad 29%
Happy 2.8%
Confused 0.8%
Surprised 0.6%
Disgusted 0.3%
Angry 0.2%
Fear 0.2%

AWS Rekognition

Age 36-44
Gender Male, 93.7%
Calm 81.9%
Happy 12.9%
Sad 3.7%
Surprised 0.5%
Confused 0.4%
Fear 0.3%
Disgusted 0.2%
Angry 0.1%

AWS Rekognition

Age 16-22
Gender Male, 95.7%
Happy 95.6%
Confused 1.3%
Sad 1.2%
Calm 1.1%
Fear 0.5%
Disgusted 0.2%
Surprised 0.1%
Angry 0.1%

AWS Rekognition

Age 35-43
Gender Male, 51.4%
Calm 98.6%
Happy 0.6%
Fear 0.3%
Sad 0.3%
Surprised 0.1%
Disgusted 0.1%
Confused 0.1%
Angry 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99%

Captions

Microsoft

a group of people posing for a photo 98%
an old photo of a group of people posing for the camera 97.4%
an old photo of a group of people posing for a picture 97.3%

Text analysis

Amazon

KODAK--A-1TW

Google

MJI7--YT3RA°2-- XAGOX
XAGOX
MJI7--YT3RA°2--