Human Generated Data

Title

Untitled (family portrait: two parents and three children in living room)
Date

c. 1950
People

Artist: Harry Annas, American 1897 - 1980
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.2882

Human Generated Data

Title

Untitled (family portrait: two parents and three children in living room)

People

Artist: Harry Annas, American 1897 - 1980

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-16

Person 99.3
Human 99.3
Person 99.3
Shoe 99.1
Footwear 99.1
Clothing 99.1
Apparel 99.1
Person 98.3
Person 98.3
Person 96.1
Shoe 95.7
Table Lamp 90.7
Lamp 90.7
Person 87.1
Furniture 79.7
People 78
Couch 78
Living Room 77.9
Room 77.9
Indoors 77.9
Shorts 77.3
Home Decor 70.6
Female 62.7
Kid 61.1
Child 61.1
Tie 60.5
Accessories 60.5
Accessory 60.5
Flooring 57.2
Portrait 56.9
Photography 56.9
Face 56.9
Photo 56.9
Lampshade 56.8
Chair 56.7
Leisure Activities 55.2

Imagga
created on 2022-01-16

brass 45.3
wind instrument 36.9
musical instrument 33.3
person 26.3
people 25.6
cornet 22.4
adult 21.6
player 21.1
man 19.6
golfer 17.2
portrait 16.2
male 15.6
sport 15.4
fashion 15.1
black 15
women 13.4
sexy 12.8
men 12
contestant 11.8
dress 11.7
model 11.7
lady 11.3
attractive 11.2
elegance 10.9
leisure 10.8
silhouette 10.7
clothing 10.7
bugle 10.6
group 10.5
style 10.4
play 10.3
youth 10.2
device 10.2
happiness 10.2
happy 10
exercise 10
trombone 9.9
old 9.7
human 9.7
outdoors 9.7
body 9.6
ball 9.5
art 9.4
lifestyle 9.4
dark 9.2
girls 9.1
fun 9
cool 8.9
couple 8.7
bride 8.6
face 8.5
business 8.5
outdoor 8.4
pretty 8.4
holding 8.2
competition 8.2
active 8.2
athlete 8.1
recreation 8.1
game 8
kin 7.8
performer 7.7
summer 7.7
married 7.7
casual 7.6
hand 7.6
wedding 7.4
fitness 7.2
love 7.1
dancer 7
modern 7

Google
created on 2022-01-16

Dress 83.5
Classic 73.9
Monochrome 70.7
Vintage clothing 70.5
Suit 70.4
Lamp 70.3
Room 70.1
Chair 69.9
Monochrome photography 67.9
Sitting 66.9
Event 66.2
Table 65.5
Stock photography 63.8
Art 60.9
History 59.2
Visual arts 56.1
Collection 56
Retro style 55.1
Child 54.7
Illustration 53.1

Microsoft
created on 2022-01-16

clothing 96
person 92.8
footwear 87.9
text 85.7
standing 82.2
cartoon 60

Face analysis

Amazon

Google

AWS Rekognition

Age 25-35
Gender Male, 100%
Calm 94.2%
Surprised 1.8%
Happy 1.5%
Sad 1%
Disgusted 0.6%
Angry 0.4%
Confused 0.3%
Fear 0.2%

AWS Rekognition

Age 48-56
Gender Male, 100%
Sad 37.5%
Confused 26.4%
Calm 23.6%
Surprised 5.2%
Disgusted 2.2%
Angry 2.1%
Happy 1.8%
Fear 1.2%

AWS Rekognition

Age 35-43
Gender Male, 99.7%
Calm 44.3%
Sad 38.3%
Happy 13.2%
Confused 2%
Angry 0.8%
Disgusted 0.5%
Surprised 0.5%
Fear 0.5%

AWS Rekognition

Age 37-45
Gender Male, 95.3%
Happy 45.2%
Calm 23.8%
Surprised 12.5%
Sad 9.1%
Fear 5.5%
Angry 1.8%
Disgusted 1.2%
Confused 0.8%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%
Shoe 99.1%
Tie 60.5%

Captions

Microsoft

a group of people posing for a photo 91.9%
a group of people standing in front of a window 86.7%
a group of people posing for the camera 86.6%

Text analysis

Amazon

2