Human Generated Data

Title

Untitled (nine children posed sitting in front of fireplace decorated with stockings)
Date

1968
People

Artist: Martin Schweig, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.10097

Human Generated Data

Title

Untitled (nine children posed sitting in front of fireplace decorated with stockings)

People

Artist: Martin Schweig, American 20th century

Date

1968

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-28

Human 98.9
Person 98.9
Person 98.3
Person 97.9
Person 97.6
Person 96.8
People 94.7
Person 93.3
Person 91.4
Person 90.2
Person 89.3
Family 79
Indoors 67.3
Room 65.4
Crowd 60.7
Workshop 59.1
Curtain 58.5

Imagga
created on 2022-01-28

blackboard 68.2
monitor 28.6
web site 22.6
television 22.2
screen 18.5
frame 17.5
grunge 17
design 16.9
business 16.4
black 16.2
computer 16.1
old 16
room 15.4
graphic 15.3
classroom 15.2
vintage 14.9
man 14.1
pattern 13.7
office 13.3
retro 13.1
freight car 13
art 13
text 12.2
film 11.9
equipment 11.8
people 11.7
space 11.6
digital 11.3
cinema 11.3
structure 11.3
modern 11.2
electronic equipment 11.1
entertainment 11
decoration 11
paint 10.9
dirty 10.8
movie 10.7
antique 10.4
finance 10.1
building 9.9
border 9.9
male 9.9
telecommunication system 9.9
chalkboard 9.8
liquid crystal display 9.8
texture 9.7
car 9.7
technology 9.6
billboard 9.3
school 9.3
house 9.2
silhouette 9.1
success 8.8
drawing 8.7
wheeled vehicle 8.5
rough 8.2
happy 8.1
board 8.1
team 8.1
home 8
businessman 7.9
paper 7.9
designed 7.9
noise 7.8
scratch 7.8
education 7.8
collage 7.7
damaged 7.6
grungy 7.6
theater 7.5
university 7.4
copy space 7.2
financial 7.1
information 7.1
display 7.1
architecture 7

Google
created on 2022-01-28

Rectangle 85.9
Art 82
Font 81.1
Window 73.9
Monochrome photography 72.9
Monochrome 71.8
Event 71.5
Door 71.4
Wood 70.9
Visual arts 69.7
Room 66.1
Painting 63.7
Pattern 63.6
Illustration 63.3
Plant 61.6
History 60.5
Picture frame 60.4
Facade 58.4
Photo caption 55.1
Display device 52.1

Microsoft
created on 2022-01-28

text 99.2
person 80.5
clothing 52.9
old 52.6
posing 36.9

Face analysis

Amazon

Google

AWS Rekognition

Age 40-48
Gender Male, 91%
Calm 46.3%
Sad 37.8%
Happy 14.1%
Confused 0.5%
Disgusted 0.5%
Angry 0.4%
Fear 0.2%
Surprised 0.2%

AWS Rekognition

Age 34-42
Gender Male, 98.3%
Confused 75.2%
Sad 20%
Calm 1.8%
Disgusted 0.9%
Happy 0.8%
Angry 0.6%
Surprised 0.4%
Fear 0.3%

AWS Rekognition

Age 24-34
Gender Female, 53.9%
Sad 60.8%
Disgusted 14.5%
Calm 8.7%
Confused 5%
Happy 3.6%
Angry 3.2%
Fear 2.5%
Surprised 1.5%

AWS Rekognition

Age 25-35
Gender Female, 85.8%
Calm 45.2%
Happy 26.1%
Sad 8.4%
Fear 6.4%
Surprised 5.4%
Angry 3.3%
Confused 2.9%
Disgusted 2.3%

AWS Rekognition

Age 45-53
Gender Male, 91.2%
Sad 95.3%
Calm 3.5%
Confused 0.3%
Fear 0.2%
Angry 0.2%
Happy 0.2%
Surprised 0.1%
Disgusted 0.1%

AWS Rekognition

Age 45-53
Gender Male, 99.7%
Calm 64.3%
Sad 27.6%
Happy 2.7%
Confused 1.5%
Surprised 1.3%
Angry 1%
Disgusted 0.9%
Fear 0.7%

AWS Rekognition

Age 34-42
Gender Male, 99.6%
Sad 86.2%
Calm 8.4%
Angry 1.2%
Disgusted 0.9%
Fear 0.9%
Surprised 0.8%
Happy 0.8%
Confused 0.7%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.9%

Captions

Microsoft

a vintage photo of a group of people posing for the camera 59.2%
a vintage photo of a group of people posing for a picture 59.1%
a vintage photo of a group of people in a room 59%

Text analysis

Amazon

FILM
KODAK
2
3
KODAK SAFETY
ILM
JULiE
SAFETY
ktu
Date

Google

S'AFETY
KODAK
LM
FILM
LM KODAK S'AFETY FILM KODAK S'AFETY