Human Generated Data

Title

Untitled (girl playing Elvis record)
Date

c. 1950, printed later
People

Artist: Lucian and Mary Brown, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.164

Human Generated Data

Title

Untitled (girl playing Elvis record)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950, printed later

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.164

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Furniture 100
Home Decor 99.9
Human 99.4
Person 99.4
Bed 98
Bedroom 93.6
Room 93.6
Indoors 93.6
Interior Design 79.8
Window 71.9
Lamp 59.7
Curtain 58.5
Table Lamp 56.1

Clarifai
created on 2023-10-27

people 99.6
one 98.5
woman 97.6
monochrome 97.3
portrait 96.2
room 94.7
adult 94.7
two 94.3
furniture 94.2
man 93.6
family 93
indoors 91.5
collage 90.5
bed 89.4
girl 88.1
retro 87.9
sit 86.3
person 81.8
three 81.7
paper 81.6

Imagga
created on 2022-01-23

musical instrument 57.3
accordion 48.8
wind instrument 39
keyboard instrument 38.6
computer 30.9
laptop 30.8
adult 30.2
people 25.7
office 25.3
business 23.1
person 23.1
working 22.1
work 22.1
smiling 21.7
indoors 21.1
home 20.7
man 20.2
room 19.8
sitting 18.9
cheerful 18.7
professional 18.7
smile 18.5
happy 17.5
technology 17.1
concertina 16.4
male 16.3
interior 15.9
businesswoman 15.4
job 15
portrait 14.9
student 14.6
women 14.2
happiness 14.1
attractive 14
lifestyle 13.7
indoor 13.7
free-reed instrument 13.7
pretty 13.3
confident 12.7
worker 12.5
holding 12.4
corporate 12
device 11.8
communication 11.8
businessman 11.5
executive 11.1
20s 11
house 10.9
desk 10.7
table 10.6
modern 10.5
success 10.5
looking 10.4
phone 10.1
book 9.9
couch 9.7
education 9.5
reading 9.5
college 9.5
adults 9.5
casual 9.3
chair 9.3
lady 8.9
furniture 8.8
using 8.7
men 8.6
talking 8.6
keyboard 8.4
senior 8.4
manager 8.4
successful 8.2
suit 8.2
one 8.2
sofa 8.1
brunette 7.8
face 7.8
break 7.6
businesspeople 7.6
females 7.6
fashion 7.5
notebook 7.3
group 7.3
black 7.2
clothing 7.1

Google
created on 2022-01-23

Hat 88.5
Style 83.8
Black-and-white 83.6
Picture frame 82.7
Musical instrument 78
Monochrome photography 73.1
Monochrome 72.4
Vintage clothing 68.4
Flooring 66.6
House 66.4
Room 65.2
T-shirt 63.7
Building 61.6
Linens 59.9
Curtain 54.2
Sitting 54.1
Retro style 53.9
Pattern 51.1
Door 51.1

Microsoft
created on 2022-01-23

text 99.1
indoor 98.1
person 96.4
black and white 91
clothing 88
window 82.6
furniture 76.2
man 71.9

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 12-20
Gender Female, 91.5%
Happy 91.3%
Fear 3.6%
Surprised 1.5%
Disgusted 1.2%
Angry 1%
Sad 0.7%
Calm 0.3%
Confused 0.3%

Microsoft Cognitive Services

Age 9
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Bed 98%

Captions

Microsoft
created on 2022-01-23

a man standing in a room 91.3%
a man that is standing in a room 88.5%
a man standing next to a window 54.5%

Text analysis

Amazon

ELVIS
-

Google

ELVIS LLLLLLLLLLLL.
ELVIS
LLLLLLLLLLLL.