Human Generated Data

Title

Untitled (two young men posed with young woman reading Dr. Seuss book in living room)
Date

1951
People

Artist: Martin Schweig, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9377

Human Generated Data

Title

Untitled (two young men posed with young woman reading Dr. Seuss book in living room)

People

Artist: Martin Schweig, American 20th century

Date

1951

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Person 98.2
Human 98.2
Person 97.8
Person 97.4
Table Lamp 93.1
Lamp 93.1
Plant 91.7
Couch 89.9
Furniture 89.9
Living Room 89.2
Room 89.2
Indoors 89.2
Interior Design 88.4
Flower 80.6
Blossom 80.6
Clothing 80
Apparel 80
Home Decor 69
Flower Arrangement 67.9
Tie 66.5
Accessories 66.5
Accessory 66.5
Portrait 58.5
Photography 58.5
Face 58.5
Photo 58.5
Flower Bouquet 58.1
Cabinet 57.1
Sitting 56.5

Imagga
created on 2022-01-23

man 36.3
adult 36.3
people 34
person 32
teacher 29
male 28.4
professional 27.1
indoors 22
couple 21.8
educator 20.8
room 20.1
business 20
home 19.9
domestic 19.8
happy 19.4
women 19
work 19
smiling 18.8
happiness 18
groom 17.9
businessman 16.8
holding 16.5
office 16.3
men 16.3
smile 15.7
dress 15.4
lifestyle 15.2
indoor 14.6
sitting 14.6
house 14.2
interior 14.2
outfit 13.8
corporate 13.7
clothing 13.7
two 13.6
desk 13.4
life 13.2
suit 12.7
bride 12.6
worker 12
looking 12
wedding 12
love 11.8
executive 11.7
job 11.5
meeting 11.3
laptop 10.9
businesswoman 10.9
husband 10.8
team 10.8
full length 10.7
cheerful 10.6
modern 10.5
table 10.5
group 10.5
color 10
hand 9.9
fashion 9.8
lady 9.7
working 9.7
portrait 9.7
chair 9.7
married 9.6
businesspeople 9.5
wife 9.5
togetherness 9.4
new 8.9
computer 8.8
together 8.8
day 8.6
adults 8.5
casual 8.5
attractive 8.4
director 8.3
handsome 8
patient 7.9
standing 7.8
bouquet 7.7
pretty 7.7
workplace 7.6
reading 7.6
marriage 7.6
bed 7.6
elegance 7.6
communication 7.6
furniture 7.6
clothes 7.5
fun 7.5
phone 7.4
confident 7.3
board 7.2
bedroom 7.1

Google
created on 2022-01-23

Photograph 94.2
Black 89.9
Picture frame 88.3
Black-and-white 85.9
Style 84
Art 79.9
Monochrome photography 76.6
Snapshot 74.3
Monochrome 72.8
Event 72.4
Room 71.1
Fashion design 66
Vintage clothing 65.2
Stock photography 63.8
Still life photography 62.9
Visual arts 62.7
Curtain 62
Sitting 60.7
Photographic paper 57.9
Linens 55.3

Microsoft
created on 2022-01-23

text 98.9
person 91
clothing 90.7
table 84.7
furniture 82.4
man 66.7
clothes 20.7

Face analysis

Amazon

Google

AWS Rekognition

Age 45-51
Gender Male, 99.8%
Confused 54.1%
Calm 17%
Happy 10.2%
Surprised 9.4%
Sad 5.3%
Disgusted 2.4%
Angry 1.3%
Fear 0.4%

AWS Rekognition

Age 25-35
Gender Female, 99.3%
Calm 98.2%
Sad 0.4%
Happy 0.4%
Angry 0.3%
Confused 0.2%
Surprised 0.2%
Disgusted 0.1%
Fear 0.1%

AWS Rekognition

Age 38-46
Gender Female, 54.2%
Happy 99.8%
Angry 0.1%
Calm 0.1%
Sad 0%
Surprised 0%
Confused 0%
Disgusted 0%
Fear 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.2%
Tie 66.5%

Captions

Microsoft

a man and a woman standing in a room 63.4%
an old photo of a person 63.3%
a person standing in a room 63.2%

Text analysis

Amazon

RAN
BY
I
IF I RAN
IF
ZOO
Dr.Sevois
a
revss
KODAK-SVEELA

Google

Z00 YT3RA2 XAGOM
Z00
YT3RA2
XAGOM