Human Generated Data

Title

Untitled (nine children posed sitting in front of fireplace decorated with stockings)
Date

1968
People

Artist: Martin Schweig, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.10105

Human Generated Data

Title

Untitled (nine children posed sitting in front of fireplace decorated with stockings)

People

Artist: Martin Schweig, American 20th century

Date

1968

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-28

Person 99.3
Human 99.3
Person 98.7
Person 98
Person 97.6
Person 96.7
Person 96
Person 95.1
Room 92.1
Indoors 92.1
Living Room 92.1
People 90.2
Person 84.4
Face 74.5
Furniture 72.2
Sideboard 68.8
Person 68.7
Female 66.2
Clothing 63.1
Apparel 63.1
Photography 62.8
Portrait 62.8
Photo 62.8
Girl 61.2
Art 60.5
Painting 60.5
Family 60.2
Crowd 57
Cabinet 56.1
Curtain 55.8
Stage 55

Imagga
created on 2022-01-28

television 47.8
blackboard 32.2
telecommunication system 31.3
monitor 28.2
web site 19.7
old 15.3
structure 15.2
man 13.4
screen 13
design 12.9
building 12.5
art 12.5
equipment 12.3
business 12.1
black 12
electronic equipment 11.9
room 11.7
architecture 11.7
frame 11.6
vintage 11.6
people 11.1
history 10.7
computer 10.7
freight car 10.6
male 10.6
antique 10.4
classroom 10.3
pattern 9.6
window 9.5
grunge 9.4
finance 9.3
person 9.3
house 9.2
office 9.1
modern 9.1
tourism 9.1
cinema 9
technology 8.9
car 8.9
decoration 8.8
home 8.8
symbol 8.7
monument 8.4
silhouette 8.3
theater 8.2
paint 8.1
graphic 8
night 8
chalkboard 7.8
sculpture 7.8
statue 7.6
historical 7.5
retro 7.4
tourist 7.2
color 7.2
copy space 7.2
interior 7.1

Google
created on 2022-01-28

Rectangle 85.4
Black-and-white 83.2
Font 82.7
Art 80
Adaptation 79.2
Picture frame 79.2
Event 73.3
Monochrome photography 71.5
Monochrome 70.1
Visual arts 68.9
Room 67.3
Door 66.8
Painting 65.9
Curtain 65
History 63.5
Illustration 63.5
Photo caption 60.8
Facade 55.2
Still life photography 53.8
Vintage clothing 53.5

Microsoft
created on 2022-01-28

text 99.2
candle 75.1
person 64.6
gallery 63.2
room 51
picture frame 15

Face analysis

Amazon

Google

AWS Rekognition

Age 36-44
Gender Male, 99.8%
Confused 49.6%
Sad 38%
Happy 5.5%
Disgusted 2.1%
Calm 1.4%
Surprised 1.4%
Angry 1%
Fear 1%

AWS Rekognition

Age 42-50
Gender Male, 82.5%
Sad 53.1%
Calm 15.2%
Happy 10.2%
Confused 7.9%
Surprised 4.7%
Disgusted 3.9%
Angry 3%
Fear 2%

AWS Rekognition

Age 47-53
Gender Male, 93.1%
Calm 27.2%
Disgusted 18.4%
Confused 15.9%
Angry 11.8%
Sad 11%
Happy 7%
Surprised 6.7%
Fear 2%

AWS Rekognition

Age 23-33
Gender Male, 95.2%
Sad 88.1%
Calm 10%
Fear 0.7%
Disgusted 0.5%
Angry 0.2%
Happy 0.2%
Confused 0.2%
Surprised 0.1%

AWS Rekognition

Age 34-42
Gender Male, 86.6%
Sad 92.8%
Surprised 3.2%
Calm 1.3%
Fear 1.2%
Confused 0.5%
Angry 0.4%
Happy 0.3%
Disgusted 0.2%

AWS Rekognition

Age 23-31
Gender Male, 98.9%
Calm 76.8%
Sad 13.5%
Confused 3.7%
Angry 2.5%
Surprised 1.2%
Disgusted 0.9%
Fear 0.7%
Happy 0.6%

AWS Rekognition

Age 37-45
Gender Male, 98.7%
Sad 64.6%
Calm 18.6%
Disgusted 5.5%
Confused 3.8%
Fear 3.6%
Surprised 1.9%
Happy 1.1%
Angry 0.8%

AWS Rekognition

Age 22-30
Gender Male, 54.1%
Confused 48.5%
Calm 26.1%
Sad 9.6%
Fear 6.6%
Disgusted 4.2%
Happy 2.2%
Surprised 1.6%
Angry 1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%
Painting 60.5%

Captions

Microsoft

a group of people in a room 74.6%
a screen shot of a group of people in a room 72.6%
a group of people standing in a room 65.2%

Text analysis

Amazon

FILM
KODAK
L
SAFETY
KODAK SAFETY
JULiE
KODA* SAFETY
KODA*
Faurt
Better

Google

YODAK S'AFETY FILM KODAK S'AFETY FILM
KODAK
YODAK
S'AFETY
FILM