Human Generated Data

Title

Untitled (holiday portrait in front of fireplace, older man and woman, two younger women)

Date

1948

People

Artist: Martin Schweig, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9130

Human Generated Data

Title

Untitled (holiday portrait in front of fireplace, older man and woman, two younger women)

People

Artist: Martin Schweig, American 20th century

Date

1948

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Clothing 99.9
Apparel 99.9
Person 98.9
Human 98.9
Person 98.6
Dress 98.5
Person 98.2
Female 97.8
Shorts 97.6
Face 95.6
Woman 88.9
Blonde 87.4
Girl 87.4
Teen 87.4
Kid 87.4
Child 87.4
Advertisement 85.7
Poster 85.7
Collage 85.7
Furniture 85.1
Person 84.9
Sleeve 80.6
Overcoat 78.2
Suit 78.2
Coat 78.2
Indoors 71.2
Portrait 71
Photo 71
Photography 71
Pants 70.4
People 70.2
Accessory 70.1
Accessories 70.1
Glasses 70.1
Shirt 67.2
Hair 64.8
Man 61.8
Fashion 60
Room 58
Gown 57.9
Table 57.7
Robe 57.1
Shelf 56.3
Flower 55.4
Plant 55.4
Blossom 55.4
Screen 55.2
Electronics 55.2
Door 55.1

Imagga
created on 2022-01-23

teacher 50.3
person 38.7
blackboard 36.5
people 36.2
man 30.2
male 29.1
adult 28.4
education 26.8
educator 25.5
classroom 23.5
negative 23.5
school 23.4
class 23.1
student 21.7
happy 21.3
professional 20.7
portrait 20
film 19.7
businessman 18.5
room 18.3
board 17.5
business 15.8
nurse 15.5
men 14.6
photographic paper 14.5
smiling 14.5
hand 14.4
women 14.2
senior 14
study 14
domestic 13.7
chalkboard 13.7
teaching 13.6
college 13.3
couple 13.1
standing 13
exam 12.4
lifestyle 12.3
desk 12.3
child 12.2
indoor 11.9
love 11.8
dress 11.7
teach 11.7
smile 11.4
group 11.3
human 11.2
looking 11.2
old 11.1
happiness 11
team 10.7
lesson 10.7
chalk 10.7
cheerful 10.6
university 10.5
together 10.5
attractive 10.5
success 10.5
writing 10.3
drawing 10.3
sitting 10.3
work 10.2
casual 10.2
book 10.1
holding 9.9
sign 9.8
photographic equipment 9.7
learn 9.4
two 9.3
world 9
office 8.9
formula 8.8
math 8.8
mathematics 8.8
boy 8.7
hands 8.7
knowledge 8.7
studying 8.6
chart 8.6
holiday 8.6
face 8.5
color 8.3
camera 8.3
interior 8
diagram 7.7
finance 7.6
guy 7.5
smart 7.5
clothing 7.5
one 7.5
patient 7.4
back 7.3
businesswoman 7.3
black 7.2
home 7.2
hair 7.1
science 7.1
to 7.1
modern 7

Google
created on 2022-01-23

Photograph 94.2
Smile 90.7
Black 89.8
Black-and-white 87.9
Sleeve 87.2
Style 84.1
Adaptation 79.4
Monochrome 78.7
Monochrome photography 77
Eyewear 76.4
Fashion design 75.3
Snapshot 74.3
Room 71.3
Font 71.1
Event 71.1
Vintage clothing 69.9
Pattern 67.7
Art 67.2
T-shirt 65.4
Photo caption 64.4

Microsoft
created on 2022-01-23

text 98.9
smile 95.4
person 94.9
clothing 93.9
human face 93.4
woman 85.4
black and white 75.1
dress 60.2
posing 41.8

Face analysis

Amazon

Google

AWS Rekognition

Age 42-50
Gender Male, 96.7%
Happy 93.9%
Calm 3.8%
Sad 1.4%
Confused 0.2%
Disgusted 0.2%
Angry 0.2%
Surprised 0.2%
Fear 0.1%

AWS Rekognition

Age 37-45
Gender Male, 97.3%
Calm 97.4%
Happy 0.8%
Sad 0.4%
Disgusted 0.3%
Confused 0.3%
Angry 0.3%
Surprised 0.2%
Fear 0.1%

AWS Rekognition

Age 31-41
Gender Female, 97.6%
Happy 92.5%
Calm 6.9%
Surprised 0.4%
Confused 0.1%
Sad 0%
Fear 0%
Disgusted 0%
Angry 0%

AWS Rekognition

Age 42-50
Gender Male, 99.9%
Happy 97.9%
Sad 0.9%
Surprised 0.5%
Calm 0.2%
Confused 0.2%
Fear 0.1%
Angry 0.1%
Disgusted 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.9%

Captions

Microsoft

a group of people posing for a photo 88.6%
a group of people posing for the camera 88.5%
a group of people posing for a picture 88.4%

Text analysis

Amazon

Greetings
MJI7
٤
MJI7 YE3RAS
00
YE3RAS

Google

MJ17
02MA
st
Greetinas st 3 | | 3 MJ17 YT3RA2 02MA
YT3RA2
|
3
Greetinas