Human Generated Data

Title

Untitled (family, missing child)

Date

1960

People

Artist: Francis J. Sullivan, American 1916 - 1996

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.18751

Human Generated Data

Title

Untitled (family, missing child)

People

Artist: Francis J. Sullivan, American 1916 - 1996

Date

1960

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Clothing 99.9
Apparel 99.9
Shorts 99.9
Person 99.5
Human 99.5
Person 99.4
Person 99.3
Chair 98.6
Furniture 98.6
Person 98.6
Person 98.4
Person 98.3
Person 97.9
Person 97.2
Person 97.1
Dress 95.7
Person 95.3
Female 95.2
Person 92
Shoe 90
Footwear 90
Building 89.7
Countryside 89.7
Outdoors 89.7
Nature 89.7
Shelter 89.7
Rural 89.7
Face 86.3
Housing 83.5
People 82.1
Shoe 81.9
Woman 81.1
Skirt 80.9
Smile 79.7
Kid 75.1
Child 75.1
Plant 73.7
Grass 73.7
Girl 73.6
Shoe 71
Person 67.1
Suit 64.6
Coat 64.6
Overcoat 64.6
Couch 61.8
Person 60.5
Photography 60.4
Photo 60.4
House 58.9
Yard 57.4
Porch 55.4
Teen 55.2

Imagga
created on 2022-03-05

brass 56.3
wind instrument 47.4
musical instrument 32.8
people 29
man 27.5
sport 27.4
silhouette 26.5
trombone 26.3
male 25.5
men 20.6
outdoors 20.1
person 18.9
athlete 17.6
group 16.9
adult 16.6
boy 16.5
couple 15.7
competition 14.6
sax 14.4
baritone 14.3
family 14.2
active 14.2
lifestyle 13.7
child 13.5
sunset 13.5
together 13.1
field 12.5
summer 12.2
player 12.1
fun 12
happy 11.9
exercise 11.8
beach 11.8
happiness 11.7
team 11.6
outdoor 11.5
ball 11.3
sky 10.8
kin 10.6
run 10.6
play 10.3
friendship 10.3
women 10.3
grass 10.3
teenager 10
recreation 9.9
trainer 9.8
black 9.6
training 9.2
fitness 9
father 9
goal 8.6
crowd 8.6
running 8.6
day 8.6
youth 8.5
business 8.5
joy 8.3
life 8.2
children 8.2
success 8
kid 8
businessman 7.9
art 7.9
son 7.6
relax 7.6
kids 7.5
enjoy 7.5
leisure 7.5
teamwork 7.4
vacation 7.4
playing 7.3
runner 7.3
sun 7.2
game 7.1
love 7.1
spectator 7.1

Google
created on 2022-03-05

Vertebrate 91.9
Window 86.3
Style 83.8
Art 76.9
Monochrome 74.9
Building 74.7
Vintage clothing 73.4
Monochrome photography 72.7
Room 67
History 66.6
Sitting 66.1
Event 65.6
Visual arts 64.8
Suit 63.9
Child 62
Chair 60.1
Team 59.6
Font 59
Illustration 58.1
Family 52.3

Microsoft
created on 2022-03-05

person 99
clothing 95.9
outdoor 91.5
footwear 87.9
drawing 86
standing 78.9
text 70
group 68.4
man 66.6
woman 62.4
posing 37.5

Face analysis

Amazon

Google

AWS Rekognition

Age 45-53
Gender Male, 99.3%
Happy 60.2%
Calm 28.9%
Sad 4.6%
Surprised 2.7%
Fear 1.3%
Confused 1.1%
Disgusted 0.6%
Angry 0.6%

AWS Rekognition

Age 36-44
Gender Female, 66.8%
Happy 94.4%
Calm 3.1%
Disgusted 1%
Sad 0.9%
Confused 0.2%
Angry 0.2%
Fear 0.1%
Surprised 0.1%

AWS Rekognition

Age 25-35
Gender Male, 99.9%
Calm 84.1%
Sad 6%
Angry 3.8%
Surprised 2.4%
Disgusted 1.7%
Confused 1.1%
Happy 0.6%
Fear 0.3%

AWS Rekognition

Age 24-34
Gender Female, 96.9%
Calm 87.5%
Surprised 10.7%
Sad 1.2%
Happy 0.2%
Disgusted 0.1%
Angry 0.1%
Confused 0.1%
Fear 0.1%

AWS Rekognition

Age 30-40
Gender Male, 80.7%
Calm 92.3%
Surprised 4.2%
Sad 0.9%
Happy 0.7%
Disgusted 0.6%
Angry 0.6%
Confused 0.4%
Fear 0.2%

AWS Rekognition

Age 39-47
Gender Female, 91.5%
Calm 81%
Happy 17.2%
Sad 0.8%
Confused 0.3%
Surprised 0.2%
Disgusted 0.2%
Angry 0.2%
Fear 0.1%

AWS Rekognition

Age 11-19
Gender Female, 58.1%
Calm 89.7%
Sad 6.1%
Happy 1.8%
Surprised 0.7%
Disgusted 0.5%
Fear 0.5%
Confused 0.4%
Angry 0.4%

AWS Rekognition

Age 26-36
Gender Male, 99.7%
Calm 96.4%
Surprised 1.6%
Sad 1%
Happy 0.3%
Confused 0.3%
Disgusted 0.3%
Angry 0.1%
Fear 0.1%

AWS Rekognition

Age 28-38
Gender Male, 99.7%
Calm 39.5%
Sad 38.4%
Happy 14.6%
Surprised 1.8%
Confused 1.7%
Disgusted 1.4%
Fear 1.4%
Angry 1.1%

AWS Rekognition

Age 26-36
Gender Male, 100%
Calm 64.9%
Sad 18.6%
Angry 7.4%
Happy 3.1%
Confused 1.7%
Disgusted 1.7%
Surprised 1.5%
Fear 1%

AWS Rekognition

Age 16-22
Gender Male, 50.8%
Calm 96.3%
Sad 1.7%
Happy 0.6%
Fear 0.4%
Surprised 0.3%
Angry 0.3%
Confused 0.2%
Disgusted 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Shoe 90%

Captions

Microsoft

a group of people posing for a picture 95.7%
a group of people posing for the camera 95%
a group of people posing for a photo 93.4%

Text analysis

Amazon

4
4 05213
05213