Human Generated Data

Title

Untitled (woman showing toy set to boy in living room decorated for Christmas)
Date

1948
People

Artist: Martin Schweig, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9152

Human Generated Data

Title

Untitled (woman showing toy set to boy in living room decorated for Christmas)

People

Artist: Martin Schweig, American 20th century

Date

1948

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Person 98.3
Human 98.3
Person 94.6
Living Room 92.8
Indoors 92.8
Room 92.8
Bird 90.8
Animal 90.8
Clothing 86.6
Apparel 86.6
Furniture 83.6
Flooring 76.6
Couch 69.1
Face 68.6
Plant 67.2
Leisure Activities 65
Musician 62.1
Musical Instrument 62.1
Female 61.1
Floor 61.1
Photography 56.8
Photo 56.8
Suit 55.9
Coat 55.9
Overcoat 55.9
Performer 55.3

Imagga
created on 2022-01-23

blackboard 59.5
man 32.9
male 25.5
room 24.9
newspaper 24.1
people 24
person 23.5
home 23.1
sitting 19.7
indoors 18.4
product 18.1
office 17.3
chair 17
adult 15.9
business 15.8
interior 15
creation 14.9
laptop 14.9
old 14.6
computer 14.5
businessman 14.1
senior 14
table 13.5
working 13.2
smiling 13
house 12.5
work 12.2
happy 11.9
lifestyle 11.6
holding 11.5
men 11.2
portrait 11
architecture 10.9
building 10.7
meeting 10.4
indoor 10
family 9.8
couple 9.6
worker 9.5
vintage 9.1
grandma 8.9
teacher 8.8
looking 8.8
ancient 8.6
wall 8.5
mature 8.4
inside 8.3
technology 8.2
job 8
happiness 7.8
antique 7.8
retired 7.8
modern 7.7
retirement 7.7
communication 7.6
furniture 7.4
retro 7.4
paper 7.2
idea 7.1
upright 7

Google
created on 2022-01-23

Black 89.7
Plant 88.7
Musical instrument 88.2
Musician 86.5
Black-and-white 85.5
Style 83.9
Chair 82.8
Art 77
Monochrome 74.8
Monochrome photography 74.2
Room 72.6
Vintage clothing 71.9
Music 64.9
Stock photography 62.8
Illustration 62.3
Painting 62.1
Artist 61.6
History 60.7
Visual arts 56.9
Curtain 56.2

Microsoft
created on 2022-01-23

text 97.9
indoor 91.7
living 90.2
room 84.2
black and white 84
piano 80.1
person 78.1
chair 76.6
table 75
clothing 72.2
old 45.8
furniture 23.6
cluttered 13.3

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 45-53
Gender Female, 66.5%
Happy 63.6%
Calm 32.7%
Sad 1.7%
Confused 0.7%
Disgusted 0.4%
Angry 0.3%
Surprised 0.3%
Fear 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.3%
Bird 90.8%

Captions

Microsoft

a group of people in a living room 84.5%
an old photo of a living room 84.4%
a group of people in the living room 83%

Text analysis

Amazon

3
Bill
4
st 3
ZING
st
S
WAOOPEE
ThE
ThE Г.
MJIF
O
Г.

Google

MJI7 YT3RA2 4. Bill WAO0 PE
MJI7
YT3RA2
4.
Bill
WAO0
PE