Human Generated Data

Title

Untitled (man, woman, and baby by window)

Date

1962

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16502

Human Generated Data

Title

Untitled (man, woman, and baby by window)

People

Artist: Lucian and Mary Brown, American

Date

1962

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-11

Furniture 99.7
Chair 99.7
Person 99.6
Human 99.6
Person 99.4
Clothing 99.4
Apparel 99.4
Person 99.3
Shorts 87.4
Home Decor 74.2
Face 73.7
Sitting 64.7
Hat 64.2
Plant 63.4
Door 63.1
Indoors 58.2
Pants 57.2
Child 57
Kid 57

Imagga
created on 2022-02-11

man 32.9
person 31.2
people 30.1
male 29.8
world 25.5
adult 25.3
senior 20.6
happy 19.4
businessman 19.4
smiling 18.8
blackboard 18.3
portrait 18.1
men 18
business 17.6
indoors 17.6
teacher 16.8
professional 16.2
sitting 15.4
office 15.3
couple 14.8
looking 14.4
life 14.3
education 13.8
women 13.4
elderly 13.4
job 13.3
musical instrument 13.1
mature 13
group 12.9
executive 12.6
home 12
old 11.8
day 11.8
holding 11.5
classroom 11.5
child 11.3
love 11
work 11
worker 10.9
lifestyle 10.8
room 10.8
working 10.6
teamwork 10.2
happiness 10.2
casual 10.2
indoor 10
older 9.7
class 9.6
school 9.6
two 9.3
smile 9.3
active 9.2
alone 9.1
black 9
human 9
team 9
family 8.9
computer 8.8
patient 8.7
bride 8.6
meeting 8.5
wind instrument 8.4
camera 8.3
student 8.2
educator 8.2
fun 8.2
laptop 8.2
board 8.1
employee 8.1
handsome 8
hair 7.9
60s 7.8
teaching 7.8
chair 7.8
retired 7.7
corporate 7.7
desk 7.6
study 7.5
wedding 7.4
back 7.3
cheerful 7.3
sexy 7.2
suit 7.2
face 7.1
together 7

Google
created on 2022-02-11

Black-and-white 85.8
Style 84
Tree 79.3
Window 79.2
Shorts 78.4
Monochrome photography 75.2
Monochrome 75.2
Event 73.1
Vintage clothing 72.1
Room 67.9
Sitting 65.6
Curtain 65.1
T-shirt 62.5
Fun 60.8
History 55
Chair 54.7
Conversation 54.3
Family 53.4
Photo caption 51.2

Microsoft
created on 2022-02-11

window 95
clothing 94.8
human face 91.4
text 91.3
person 87.7
posing 49.7

Face analysis

Amazon

Google

AWS Rekognition

Age 50-58
Gender Male, 96%
Calm 98.7%
Surprised 1%
Sad 0.3%
Confused 0%
Disgusted 0%
Happy 0%
Angry 0%
Fear 0%

AWS Rekognition

Age 31-41
Gender Male, 75.7%
Happy 94.5%
Surprised 4.5%
Angry 0.3%
Fear 0.2%
Calm 0.2%
Confused 0.1%
Disgusted 0.1%
Sad 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%

Captions

Microsoft

a group of people standing in front of a window 90.4%
a group of people posing for a photo in front of a window 89.6%
a group of people sitting and standing in front of a window 88.1%

Text analysis

Amazon

2

Google

YT37A°2
-
XAGO
MJI7-- YT37A°2 - - XAGO
MJI7--