Human Generated Data

Title

Untitled (boy with model boats)

Date

c. 1950

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17414

Human Generated Data

Title

Untitled (boy with model boats)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Person 99.7
Human 99.7
Clothing 89.5
Apparel 89.5
Boat 83.8
Vehicle 83.8
Transportation 83.8
Photography 69.4
Photo 69.4
Portrait 69.4
Face 69.4
Female 68.7
Wood 65.5
Indoors 65.3
Room 65.1
Shelf 64.7
Shorts 62
Furniture 61.6
Finger 60.1
Table 59.4
Plywood 58.8
Window 58.4
Girl 57.5

Imagga
created on 2022-02-26

dishwasher 100
white goods 100
home appliance 97.8
appliance 79.1
kitchen 60.1
interior 58.4
home 53.4
house 45.9
modern 39.9
furniture 37.8
durables 32
room 31.1
decor 30.9
stove 30.5
cooking 29.7
oven 27.8
indoor 27.4
indoors 27.2
luxury 26.6
cabinet 26
design 25.9
cook 22.9
table 22.6
sink 21.6
counter 21
architecture 20.3
apartment 20.1
wood 20
estate 19.9
contemporary 19.7
floor 19.5
stainless 19.4
clean 19.2
domestic 19
inside 18.4
food 17.5
residential 16.3
decoration 15.9
luxurious 15.6
style 15.6
steel 15
faucet 13.8
expensive 13.4
real 13.3
glass 13.2
new 13
refrigerator 12.7
man 12.1
window 11.9
cabinets 11.9
dinner 11.8
granite 11.7
people 11.7
equipment 11.6
light 11.4
elegant 11.1
wall 11.1
work 11
remodel 10.9
working 10.6
wooden 10.5
dining 10.5
tile 10.5
computer 10.4
cupboard 9.9
shelf 9.8
lifestyle 9.4
3d 9.3
appliances 8.9
microwave 8.8
real estate 8.8
smiling 8.7
chair 8.5
office 8.3
residence 7.8
nobody 7.8
elegance 7.6
technology 7.4
brown 7.4
island 7.3
metal 7.2
stylish 7.2
male 7.1
kitchen appliance 7

Google
created on 2022-02-26

Microsoft
created on 2022-02-26

person 99.6
indoor 99.1
text 96.4
window 94
piano 73.2
black and white 53.1
musical instrument 52.8

Face analysis

Amazon

Google

AWS Rekognition

Age 18-24
Gender Male, 55.7%
Calm 84.1%
Sad 11.1%
Confused 3.2%
Angry 0.4%
Happy 0.4%
Disgusted 0.3%
Surprised 0.3%
Fear 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%
Boat 83.8%

Captions

Microsoft

a person standing in front of a window 77.9%
a man and a woman standing in front of a window 50.9%
a boy standing in front of a window 48.2%

Text analysis

Amazon

-
ATAWAM
- DELLA
NAD
DELLA
1814
WALK 1814 ONLA
ONLA
KODAKA--EITW
WALK

Google

-
YT37A°2
XAGO
MJI7-- YT37A°2 - - XAGO
MJI7--