Human Generated Data

Title

Untitled (three women with group of children seated on chairs, Methodist Church)
Date

c. 1950
People

Artist: Harry Annas, American 1897 - 1980
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.2761

Human Generated Data

Title

Untitled (three women with group of children seated on chairs, Methodist Church)

People

Artist: Harry Annas, American 1897 - 1980

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-16

Apparel 99.8
Clothing 99.8
Human 99.6
Person 99.6
Person 99.6
Shorts 99.6
Person 99.5
Person 99.2
Person 99.2
Shoe 97.2
Footwear 97.2
Shoe 94.8
Person 93.8
People 93.8
Person 92.8
Person 92.2
Person 91.6
Shoe 89
Shoe 88.9
Person 79
Person 78.5
Female 78.3
Child 72.8
Kid 72.8
Family 67.7
Girl 67
Room 66.4
Indoors 66.4
Hat 65.6
Overcoat 60.5
Suit 60.5
Coat 60.5
Shoe 59.8
Stage 57.5
Person 44.1

Imagga
created on 2022-01-16

brass 40.4
wind instrument 30.2
person 30.1
people 28.4
sport 28.1
male 24.8
man 24.2
men 22.3
adult 21.1
musical instrument 20.2
active 20.1
exercise 18.1
silhouette 17.4
nurse 16.9
fun 16.4
planner 15.7
boy 14.8
happy 13.8
outdoor 13.7
lifestyle 13.7
group 13.7
activity 13.4
black 13.2
player 12.9
summer 12.8
sky 12.1
play 12.1
action 12
human 12
athlete 11.9
youth 11.9
women 11.8
happiness 11.7
joy 11.7
child 11.5
art 11.3
competition 11
cornet 10.9
fitness 10.8
leisure 10.8
team 10.7
family 10.7
dance 10.4
motion 10.3
grass 10.3
dark 10
professional 9.8
outdoors 9.7
run 9.6
gymnasium 9.6
casual 9.3
training 9.2
field 9.2
freedom 9.1
teenager 9.1
girls 9.1
jump 8.6
crowd 8.6
business 8.5
life 8.5
friendship 8.4
portrait 8.4
power 8.4
kin 8.1
body 8
celebration 8
businessman 7.9
together 7.9
standing 7.8
party 7.7
facility 7.7
athletic facility 7.7
health 7.6
healthy 7.5
legs 7.5
ball 7.4
event 7.4
pose 7.2
success 7.2
smiling 7.2
dress 7.2
suit 7.2
sunset 7.2
game 7.1
love 7.1
spring 7.1
teacher 7.1

Google
created on 2022-01-16

Dress 85.6
Style 83.9
Black-and-white 82.1
Font 76.8
Monochrome photography 73.8
Vintage clothing 73.5
Event 73.3
Monochrome 72.5
Hat 69.2
Crew 68.5
Fun 68.1
Room 67.3
Art 67.3
History 65.1
Suit 64.2
Team 64.1
Visual arts 59.9
Photo caption 59.6
Uniform 58.2
Child 57.4

Microsoft
created on 2022-01-16

person 98.8
text 95.5
clothing 94.9
footwear 89.8
outdoor 87.4
group 84.4
woman 71.8
player 60.8
people 55.2
dance 52.1
posing 49.8
old 43.3
team 34.8
clothes 17.9
crowd 0.7

Face analysis

Amazon

Google

AWS Rekognition

Age 48-56
Gender Male, 98%
Happy 62.3%
Calm 10.8%
Angry 7.9%
Fear 6.7%
Surprised 5%
Sad 2.8%
Disgusted 2.5%
Confused 2%

AWS Rekognition

Age 29-39
Gender Male, 93%
Calm 98.7%
Happy 0.5%
Sad 0.3%
Angry 0.2%
Disgusted 0.1%
Confused 0.1%
Surprised 0.1%
Fear 0%

AWS Rekognition

Age 52-60
Gender Male, 99.8%
Calm 93.9%
Sad 4.5%
Confused 0.7%
Happy 0.3%
Angry 0.3%
Disgusted 0.1%
Surprised 0.1%
Fear 0.1%

AWS Rekognition

Age 36-44
Gender Male, 64.4%
Happy 48.5%
Calm 44.8%
Surprised 2.1%
Sad 1.6%
Confused 1.2%
Disgusted 0.9%
Angry 0.5%
Fear 0.4%

AWS Rekognition

Age 27-37
Gender Male, 97.3%
Calm 96.3%
Surprised 1.1%
Angry 1.1%
Sad 0.8%
Confused 0.3%
Disgusted 0.2%
Fear 0.1%
Happy 0.1%

AWS Rekognition

Age 36-44
Gender Male, 94.1%
Calm 98.6%
Angry 0.5%
Surprised 0.3%
Disgusted 0.3%
Happy 0.2%
Confused 0.1%
Sad 0.1%
Fear 0%

AWS Rekognition

Age 48-56
Gender Male, 98.8%
Calm 88.1%
Surprised 5.4%
Happy 4%
Fear 0.9%
Disgusted 0.8%
Angry 0.4%
Confused 0.3%
Sad 0.2%

AWS Rekognition

Age 39-47
Gender Male, 92.2%
Happy 78.8%
Surprised 8.8%
Calm 8.8%
Sad 2.3%
Fear 0.6%
Confused 0.3%
Angry 0.2%
Disgusted 0.2%

AWS Rekognition

Age 22-30
Gender Male, 96%
Calm 94.1%
Surprised 4.6%
Angry 0.3%
Disgusted 0.3%
Happy 0.2%
Fear 0.2%
Sad 0.1%
Confused 0.1%

AWS Rekognition

Age 24-34
Gender Female, 77.2%
Calm 68.6%
Happy 24.6%
Angry 2.7%
Surprised 1.7%
Fear 1%
Disgusted 0.5%
Sad 0.5%
Confused 0.3%

AWS Rekognition

Age 43-51
Gender Male, 99.8%
Calm 69.1%
Sad 19.2%
Angry 4%
Surprised 2.3%
Confused 1.8%
Happy 1.7%
Disgusted 1%
Fear 1%

AWS Rekognition

Age 30-40
Gender Male, 69%
Happy 47.8%
Calm 28.6%
Sad 16.4%
Angry 2.3%
Confused 1.7%
Disgusted 1.3%
Surprised 1%
Fear 0.9%

AWS Rekognition

Age 39-47
Gender Male, 93.8%
Calm 94%
Sad 2.5%
Happy 0.9%
Surprised 0.9%
Angry 0.8%
Confused 0.4%
Fear 0.3%
Disgusted 0.2%

AWS Rekognition

Age 54-64
Gender Female, 53.5%
Sad 80.9%
Calm 11.8%
Angry 2.4%
Confused 1.5%
Fear 1.1%
Disgusted 1%
Surprised 0.7%
Happy 0.5%

AWS Rekognition

Age 43-51
Gender Male, 100%
Calm 93.6%
Sad 4.7%
Surprised 0.5%
Angry 0.4%
Happy 0.2%
Confused 0.2%
Disgusted 0.2%
Fear 0.1%

AWS Rekognition

Age 45-53
Gender Male, 89.1%
Calm 99.7%
Sad 0.2%
Angry 0.1%
Happy 0%
Confused 0%
Surprised 0%
Fear 0%
Disgusted 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Feature analysis

Amazon

Person 99.6%
Shoe 97.2%

Captions

Microsoft

a group of people posing for a photo 91.8%
a group of people posing for a photo in front of a crowd 91.7%
a group of people posing for the camera 91.6%

Text analysis

Amazon

8
SHARING
KODAK
SAFETY

Google

SHARING
SHARING