Human Generated Data

Title

Untitled (family portrait of parents and four children)

Date

c. 1950

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16651

Human Generated Data

Title

Untitled (family portrait of parents and four children)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-18

Shorts 100
Clothing 100
Apparel 100
Person 99.7
Human 99.7
Person 99.7
Person 99.7
Person 98.7
Dress 97
Teen 96.8
Girl 96.8
Kid 96.8
Blonde 96.8
Female 96.8
Woman 96.8
Child 96.8
Person 96.4
Person 95.2
Face 71.1
Road 70
People 64.5
Accessories 63.9
Tie 63.9
Accessory 63.9
Hat 63.1
Footwear 61.5
Portrait 60.3
Photography 60.3
Photo 60.3
Furniture 56
Chair 56
Shoe 55.1
Shoe 51.7

Imagga
created on 2022-02-18

people 28.4
brass 24.9
person 21.8
couple 20.9
wind instrument 20.7
bride 18.3
man 18.1
adult 17.8
wedding 16.5
married 16.3
dress 16.2
love 15.8
happy 15.7
musical instrument 15.6
outdoors 14.9
male 14.9
men 14.6
group 14.5
women 14.2
smiling 13.7
teacher 13.6
team 13.4
professional 13.2
sport 13.1
portrait 12.9
two 12.7
happiness 12.5
dancer 12.4
human 12
lifestyle 11.6
holding 11.5
bouquet 11.3
fun 11.2
worker 11.1
business 10.9
groom 10.8
black 10.8
together 10.5
attractive 10.5
body 10.4
sitting 10.3
summer 10.3
exercise 10
performer 9.8
ball 9.8
pretty 9.8
cheerful 9.7
sexy 9.6
athlete 9.4
day 9.4
fashion 9
educator 8.8
celebration 8.8
marriage 8.5
clothing 8.5
teamwork 8.3
player 8.3
competition 8.2
suit 8.1
recreation 8.1
businessman 7.9
gown 7.8
court 7.8
bridal 7.8
wife 7.6
kin 7.5
cornet 7.5
friendship 7.5
chair 7.4
entertainer 7.4
lady 7.3
playing 7.3
office 7.2
fitness 7.2
home 7.2
work 7.2
romance 7.1
game 7.1
smile 7.1
life 7.1
supporter 7.1
job 7.1
sky 7

Google
created on 2022-02-18

Black 89.5
Black-and-white 85.8
Gesture 85.3
Style 84
Adaptation 79.3
Art 78
Monochrome photography 76.7
Tints and shades 76.5
Smile 75.5
Monochrome 74.3
Happy 71.7
Event 71.1
Vintage clothing 71.1
Tree 69.7
Photo caption 69
Font 68.7
Picture frame 66.8
Room 66.4
Fun 65.2
Sitting 64.8

Microsoft
created on 2022-02-18

person 97.6
text 97.1
clothing 92.9
outdoor 92.4
woman 63.7
man 56.2
posing 50.1

Face analysis

Amazon

Google

AWS Rekognition

Age 29-39
Gender Male, 80.3%
Happy 81.1%
Sad 7.6%
Calm 6.5%
Surprised 1.6%
Fear 1.1%
Confused 0.9%
Angry 0.6%
Disgusted 0.6%

AWS Rekognition

Age 30-40
Gender Female, 59.6%
Happy 86.9%
Calm 9.1%
Sad 1.9%
Angry 0.5%
Confused 0.5%
Fear 0.5%
Surprised 0.3%
Disgusted 0.2%

AWS Rekognition

Age 20-28
Gender Male, 69.2%
Happy 53.8%
Calm 24.5%
Surprised 11.6%
Sad 4.3%
Fear 3.3%
Angry 1%
Disgusted 0.8%
Confused 0.7%

AWS Rekognition

Age 26-36
Gender Male, 84.1%
Happy 80.2%
Surprised 7.7%
Sad 3.8%
Fear 3.4%
Calm 2.4%
Disgusted 1.3%
Angry 0.5%
Confused 0.5%

AWS Rekognition

Age 41-49
Gender Male, 98.8%
Happy 98%
Surprised 0.6%
Calm 0.6%
Angry 0.2%
Disgusted 0.2%
Fear 0.2%
Sad 0.1%
Confused 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%
Tie 63.9%
Shoe 55.1%

Captions

Microsoft

a group of people posing for a photo 96.7%
a group of people posing for the camera 96.6%
a group of people standing in front of a window 94.9%

Text analysis

Amazon

02

Google

gO
-YT
-XA
MJIA-
2-
MJIA- -YT 2- -XA gO