Human Generated Data

Title

Untitled (portrait of family lined up against house)

Date

c. 1950

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16794

Human Generated Data

Title

Untitled (portrait of family lined up against house)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Person 99.8
Human 99.8
Person 99.8
Person 99.7
Apparel 99.7
Clothing 99.7
Person 99.5
Shorts 98.8
Person 98.5
Shirt 89
Grass 87.9
Plant 87.9
Outdoors 72.9
Nature 72.4
Face 71.4
People 71
Furniture 65.8
Chair 65.8
Sleeve 65
Female 64
Brick 61
Sports 58.1
Sport 58.1
Cricket 58.1

Imagga
created on 2022-02-26

kin 55.7
people 31.8
couple 30.5
man 29.6
male 27.7
happy 25.7
smiling 24.6
together 23.6
happiness 21.9
outdoors 21.6
family 21.3
person 20.8
portrait 20
child 18.1
lifestyle 18.1
nurse 18
summer 18
two 16.9
boy 16.5
women 15.8
children 15.5
adult 15.2
walking 15.1
love 15
holding 14.8
park 14.8
mother 14.5
father 14.2
vacation 13.9
standing 13.9
men 13.7
daughter 13.5
fun 13.5
sibling 13
business 12.7
walk 12.4
son 11.6
home 11.2
active 11
leisure 10.8
smile 10.7
husband 10.6
businessman 10.6
group 10.5
wife 10.4
senior 10.3
day 10.2
beach 10.1
water 10
cheerful 9.7
30s 9.6
sky 9.6
holiday 9.3
mature 9.3
outdoor 9.2
professional 9.1
pretty 9.1
businesswoman 9.1
team 9
dad 8.8
groom 8.7
bride 8.6
outside 8.6
enjoying 8.5
youth 8.5
kids 8.5
old 8.4
joy 8.3
life 8.3
office 8.2
confident 8.2
success 8
staff 8
romantic 8
grass 7.9
brother 7.9
parents 7.8
hands 7.8
health 7.6
sport 7.6
healthy 7.6
enjoy 7.5
friends 7.5
relaxed 7.5
natural 7.4
back 7.3
20s 7.3
playing 7.3
girls 7.3
new 7.3
sunset 7.2
world 7.1
kid 7.1

Google
created on 2022-02-26

Window 81.1
Headgear 80.9
Tints and shades 77.2
Vintage clothing 74.1
Monochrome 70.8
Monochrome photography 70
Uniform 68.8
Team 65.5
Door 64.5
Classic 63.6
Room 63.1
History 63.1
Crew 61.2
Photo caption 59.9
Shorts 56.1
Sitting 55.8
Retro style 55.4
Child 53.3
Family 53.2

Microsoft
created on 2022-02-26

posing 98.4
clothing 96.5
standing 96.4
person 96.1
outdoor 95.1
smile 92
man 90.9
footwear 79.4

Face analysis

Amazon

Google

AWS Rekognition

Age 25-35
Gender Female, 72.5%
Sad 62.3%
Happy 24.6%
Disgusted 4.2%
Calm 3.2%
Angry 1.9%
Surprised 1.8%
Confused 1.2%
Fear 0.8%

AWS Rekognition

Age 23-31
Gender Male, 98.8%
Calm 70.7%
Confused 12.7%
Sad 7.3%
Happy 5.6%
Disgusted 1.2%
Angry 1.2%
Surprised 0.8%
Fear 0.5%

AWS Rekognition

Age 37-45
Gender Female, 94.8%
Sad 35%
Calm 22.9%
Happy 14.9%
Disgusted 13.6%
Surprised 4.1%
Fear 4%
Angry 3.7%
Confused 1.8%

AWS Rekognition

Age 41-49
Gender Male, 100%
Surprised 70.7%
Happy 25.8%
Calm 2.1%
Disgusted 0.5%
Fear 0.4%
Sad 0.2%
Angry 0.2%
Confused 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.8%

Captions

Microsoft

a group of people posing for a photo 96.1%
a group of people standing in front of a window posing for the camera 90.2%
a person standing in front of a group of people posing for a photo 89.6%

Text analysis

Amazon

15
G
NAGOR

Google

MJI7--YT33A°2
MJI7--YT33A°2