Human Generated Data

Title

Untitled (Mr. & Mrs. Crowthers)
Date

1951, printed later
People

Artist: Francis J. Sullivan, American 1916 - 1996
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.413

Human Generated Data

Title

Untitled (Mr. & Mrs. Crowthers)

People

Artist: Francis J. Sullivan, American 1916 - 1996

Date

1951, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Furniture 99.9
Person 99.2
Human 99.2
Person 99.2
Person 98.7
Dresser 96.2
Cabinet 96.2
Room 90.7
Indoors 90.7
Interior Design 89
Drawer 76.9
Living Room 73
Clothing 63.9
Apparel 63.9
Bed 63.4
Bedroom 61.1
Plant 60.9
Couch 56.1

Imagga
created on 2022-01-08

file 100
office furniture 100
furniture 100
home 35.9
interior 30.1
house 29.2
room 22.9
kitchen 22.3
indoors 22
office 21.7
modern 20.3
box 20.2
business 19.4
cabinet 18.7
storage 17.1
happy 15.7
indoor 15.5
man 15.4
computer 15.2
adult 14.9
people 14.5
wood 14.2
person 13.6
smile 13.5
male 13.5
decor 13.3
smiling 13
new 12.9
work 12.6
moving 11.4
wooden 11.4
cheerful 11.4
container 11.3
design 11.3
luxury 11.1
style 11.1
laptop 10.9
boxes 10.7
cooking 10.5
standing 10.4
stack 10.2
inside 10.1
lifestyle 10.1
furnishing 10
table 9.6
couple 9.6
brown 9.6
estate 9.5
happiness 9.4
locker 9.3
communication 9.2
executive 9.2
businesswoman 9.1
stove 9
sink 8.9
corporate 8.6
wall 8.6
contemporary 8.5
attractive 8.4
counter 8.3
cook 8.2
chiffonier 8.2
technology 8.2
domestic 8.1
businessman 7.9
chest 7.9
luxurious 7.8
color 7.8
men 7.7
sitting 7.7
elegance 7.5
holding 7.4
service 7.4
lady 7.3
food 7.2
success 7.2
decoration 7.2
working 7.1

Google
created on 2022-01-08

Cabinetry 95.8
Drawer 91
Chest of drawers 89.9
Dresser 89.7
Chair 84.1
Style 83.9
Cupboard 78
Chest 74.3
Classic 73.5
Monochrome photography 72.3
Room 72.3
Wood 71.8
Door 71.4
Monochrome 71.4
Vintage clothing 71.2
Art 70.3
Rectangle 70
Hardwood 65.8
Stock photography 63.5
Curtain 62.6

Microsoft
created on 2022-01-08

person 96.1
man 93.5
drawer 87
furniture 86.9
clothing 86.7
chest of drawers 85.2
text 83.8
black and white 67.2
cabinetry 56.7
desk 8.3

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 27-37
Gender Female, 100%
Angry 97%
Surprised 1.7%
Disgusted 0.9%
Happy 0.1%
Confused 0.1%
Calm 0.1%
Fear 0.1%
Sad 0%

AWS Rekognition

Age 36-44
Gender Male, 99.9%
Angry 49.3%
Calm 29%
Sad 16.5%
Confused 2.3%
Fear 1.4%
Surprised 0.9%
Disgusted 0.5%
Happy 0.1%

AWS Rekognition

Age 21-29
Gender Female, 84.7%
Sad 39.4%
Calm 31.6%
Fear 20.4%
Happy 2.7%
Disgusted 2.4%
Surprised 1.6%
Confused 1.1%
Angry 0.8%

Microsoft Cognitive Services

Age 45
Gender Male

Microsoft Cognitive Services

Age 44
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%

Captions

Microsoft

a man standing in front of a window 78.4%
a man and a woman standing in front of a window 60.6%
a man standing next to a window 60.5%

Text analysis

Amazon

59
Fift
Safete
مشهد
and

Google

S
S