Human Generated Data

Title

Untitled (girl looking at records)
Date

c. 1950
People

Artist: Lucian and Mary Brown, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17410

Human Generated Data

Title

Untitled (girl looking at records)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Person 98.6
Human 98.6
Apparel 96.9
Clothing 96.9
Face 92.4
Dress 90.2
Shelf 85.3
Female 84.8
Furniture 81.8
Indoors 73.7
Photography 72.2
Portrait 72.2
Photo 72.2
Laptop 69.9
Computer 69.9
Electronics 69.9
Pc 69.9
Sleeve 69.2
Chair 68
Woman 65.5
Girl 64.1
Plant 63
Monitor 61.3
Display 61.3
Screen 61.3
Room 59
Person 58.5
Head 58.3
Hair 57.9

Imagga
created on 2022-02-26

kitchen 52.2
room 47.9
interior 46
home 43.9
house 35.9
modern 30.8
furniture 27.8
indoors 26.3
cabinet 25.2
man 24.2
stove 22.4
domestic 22.1
people 21.8
indoor 21
luxury 20.6
male 19.9
counter 19.4
inside 19.3
cooking 19.2
shop 18.9
hairdresser 18.9
oven 18.8
cook 18.3
sink 17.6
wood 17.5
person 16.8
decor 15.9
refrigerator 15.9
barbershop 15.2
adult 14.5
worker 14.4
apartment 14.4
architecture 14.1
equipment 14
appliance 14
floor 13.9
table 13.8
stainless 13.6
design 13.5
style 13.4
food 13.3
estate 13.3
professional 13.2
hospital 13
men 12.9
tile 12.8
new 12.1
mercantile establishment 12.1
happy 11.9
work 11.8
clean 11.7
medical 11.5
smile 11.4
home appliance 11.4
light 11.4
contemporary 11.3
white goods 11.1
patient 10.8
steel 10.6
smiling 10.1
occupation 10.1
chair 9.9
remodel 9.9
window 9.7
residential 9.6
real 9.5
women 9.5
decoration 9.4
doctor 9.4
casual 9.3
holding 9.1
portrait 9.1
faucet 8.9
luxurious 8.8
office 8.7
wall 8.7
uniform 8.6
business 8.5
horizontal 8.4
microwave 8.2
place of business 8.1
working 8
lifestyle 7.9
cabinets 7.9
china cabinet 7.8
couple 7.8
granite 7.8
standing 7.8
machine 7.8
expensive 7.7
profession 7.7
health 7.6
mirror 7.6
living 7.6
restaurant 7.4
stylish 7.2
bright 7.1
marble 7.1
area 7.1
glass 7
clinic 7

Google
created on 2022-02-26

Cabinetry 94.8
Photograph 94.2
Black 89.6
Drawer 88.1
Standing 86.4
Black-and-white 85
Chest of drawers 85
Style 84
Picture frame 81.6
Kitchen 79.3
Countertop 78.3
People 78.2
Lamp 76.5
Snapshot 74.3
Monochrome 73.4
Monochrome photography 73.4
Hat 72.8
Chest 72.4
Vintage clothing 69.9
Room 69.4

Microsoft
created on 2022-02-26

person 99.5
man 98.6
indoor 88.5
text 87.7
wedding dress 85.4
clothing 84
dress 80.5
standing 76
woman 61
black and white 59.8
bride 59.1
preparing 45.8

Face analysis

Amazon

Google

AWS Rekognition

Age 23-31
Gender Female, 51.4%
Calm 90.2%
Sad 5.8%
Surprised 2.1%
Disgusted 0.6%
Confused 0.4%
Angry 0.4%
Fear 0.3%
Happy 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.6%
Laptop 69.9%
Monitor 61.3%

Captions

Microsoft

a man standing in a kitchen 92%
a man that is standing in the kitchen 90.6%
a man and a woman standing in a kitchen 83.6%

Text analysis

Amazon

MJ17--YT37A°--X

Google

MJI7--
MJI7-- YT33A°2--ACO PLAY
YT33A°2--ACO
PLAY